Dapatkan lowongan baru via email
- ...alerting for data pipelines. Requirements 3+ years of data engineering experience. Proficiency in SQL and Python. Experience with Apache Spark, Airflow, or dbt. Hands-on experience with cloud data warehouses. Strong understanding of data modelling and pipeline best...
Rp 10juta - Rp 12juta
...Berpengalaman dalam ETL/ELT & data pipeline development Familiar dengan stream & batch processing Tools & Tech: Airbyte, Apache Airflow, Apache Kafka Pandas, NumPy, data wrangling API integration & data scraping (BeautifulSoup, Scrapy, dll) Cloud &...Rp 8.9juta - Rp 9.3juta
...Requirements: • 3+ years of experience in ETL development, preferably in banking or financial services • Strong expertise in ETL tools (Apache Airflow or similar) & Proficient in RDBMS (PostgreSQL) • Having knowledge API performance testing and tuning • Thorough...- ...complex SQL with CTEs, window functions, and analyzing query execution/query planner. Develop and manage workflow orchestration using Apache Airflow/Dagster/Prefect (or other orchestration tools). Architect and maintain cloud-based data infrastructure on Google Cloud...
- ..., and follow best practices in software development and MLOps. Key Requirements: ~ Hands-on experience with Google BigQuery & Apache AirFlow ~ Experience in remote development using cloud platforms (Google Cloud) ~ Proficient in Python, SQL and ML frameworks (e...
- ...best practices for production environments. ~ Experience with message queuing and streaming platforms (Amazon SQS, SNS, Kinesis, Apache Kafka) for scalable, event-driven architectures. ~ Strong grasp of microservices. ~ Familiarity with Golang and Node.js tools and...
- ...certifications (GCP Professional Data Engineer, Databricks, Airflow/Astronomer, etc.) are a plus Technical Skills : Streaming: Apache Kafka — topic design, consumer groups, partitioning strategy, and real-time event processing Batch Orchestration: Apache Airflow...
36000 $ per tahun
...Proven ability to take full ownership in a fully remote environment. **Strongly Preferred (Bonus Points)** Experience with Apache Kafka (especially Confluent Cloud). Deep expertise with IaC tools (Terraform, Pulumi) and DevSecOps workflow Advanced knowledge...- ...performance and scale challenges both inside and across service boundaries. Contribute to open-source projects such as DuckDB and Apache Polaris. Embrace Fivetran innovations with open-source standards and toolsets. Set technical directions and influence cross-...
- ...Google Cloud Platform services for deploying and managing cloud-based applications; ~ Excellent data visualization skills using Apache Superset or other data visualization tools; ~ Experience in data wrangling with Python/R; ~ Experience in data modeling project...
- ...and experience are equally valued Preferable: Familiar with GCP or AWS cloud service Preferable: Familiar with Cloud Dataflow/Apache Beam Preferable: Familar with Machine Learning Algorithm (Regression, Decision Tree, Neural Network/Deep Learning) and Machine...
- ...answering technical queries mainly through support tickets and live chat. We use a standard hosting stack comprising cPanel, Linux, Apache, MySQL, and PHP so experience with these technologies is crucial. The majority of the sites we host will run a CMS like WordPress,...
- ...and AI usage in mind Tech Stack Data Ingestion Python (Scrapy) AWS Fargate (Amazon ECS) Amazon Managed Workflows for Apache Airflow Data Storage Amazon S3 Amazon Aurora PostgreSQL Data Processing ~ Apache Spark (Databricks) Infrastructure...