[Databricks Data Engineering Support](https://freelancer.com/projects/data-analytics/databricks-data

[Databricks Data Engineering Support](https://freelancer.com/projects/data-analytics/databricks-data-engineering-support.html) I’m looking for hands-on help building and optimising data-engineering workflows inside Databricks. My immediate focus is on ingesting data that arrives in two ways—batch loads from relational databases and real-time streams—then transforming, testing and storing it so downstream analytics teams can trust the output. Here is what I need from you: • Design and implement robust ingestion pipelines that pull incremental data from the source databases and process the streaming feeds with minimal latency. • Develop scalable transformation logic inside notebooks (PySpark / SQL) and package reusable jobs so they can be scheduled and monitored through Databricks Wor...