Lead Data Engineer

About KPI Partners

KPI Partners is a 5 times Gartner recognized data, analytics, and AI consulting company. We are leaders in data engineering on Azure, AWS, Google, Snowflake, and Databricks. Founded in 2006, KPI has over 400 consultants and has successfully delivered over 1,000 projects to our clients.

Title: Senior Data Engineer

Location: San Francisco Bay Area (Hybrid)

Job Type: Contract – 12 Months

Keynote: Strong in SQL, Python / PySpark, SAP/BW Finance Planning, ETL, and data warehousing fundamentals

About the Role:

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team at KPI, working on challenging and multi-year data transformation projects. This is an excellent opportunity for a talented data engineer to play a key role in building innovative data solutions and related technologies. If you are passionate about working with large-scale data systems and enjoy solving complex engineering problems, this role is for you.

Must-Have Skills & Qualifications:

• 10+ Years of total experience collaborating with cross-functional teams, including machine learning engineers, software developers, analytics engineers, and product managers to translate business requirements into highly available data solutions
• 3+ years of experience developing and implementing data pipelines using PySpark.
• 3+ years of experience developing and implementing data SAP/BW Financial Planning
• Strong hands-on experience with SAP ECC, SAP BPC, Azure, and financial planning processes.
• Proven experience with SQL
• Be an independent self-learner with the “let’s get this done” approach and ability to work in Fast paced and Dynamic environment

Nice to Have Skills

• Good to have Databricks Certification
• Good to have Experience providing practical direction within azure native services , implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Synapse/DW /Azure SQL DB, Fabric.
• Good to have Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Cosmo Db knowledge.
• Good to have SAP Hana knowledge
• Intermediate knowledge on Power BI
• Good to have knowledge in DevOps and CI/CD deployments, Cloud migration methodologies and processes.