Please mention DailyRemote when applying
AI Summary
Develop streaming and batch pipelines for central operation validation and ML-based anomaly detection using Databricks. Responsibilities include feature engineering, data exploration, and implementing quality gating and auditing processes.
Information
- Start: ASAP
- Period: 6 months with possible extension
- Remote: full
- Project focus: Databricks-based central operation validation & ML-based anomaly detection vs threshold monitoring
Task
- Streaming / Batch pipeliens for integration, Data Quality, Quality Gating, Transformations, Auditing
- Feature Engineering, Data Exploration
- Align with Operators from Bas, requesting/adjusting KhZ waveform data, uniformisation (data)
- KPIs + PoC evaluation
- IaC asset bundling
- Unit Testing /+ integration testing
- Docs + formatting
- Map business pages
- Identify data sources
- Find domain expert colleagues
- Clarify ownership
- Analyze ime series
- Regime normalization
- Predictive maintenance journey
Anomaly detection
Requirement
- Azure
- Databricks
- CI/CD
- MLflow knowledge
- Anomaly detection background
- DLT
- minor: Snowflake
Automatically Apply to the Best Remote Jobs
Stop the endless job search. Our AI finds and applies to the best jobs for you.
