Avatar for Resolve Tech Solutions
Investment & tech solutions for real estate and cloud, AI, & SAP services

Data Engineer

  • |3 years of exp
  • |Contract
Posted: 1 week ago
Job Location
Remote Work Policy

In office

Visa Sponsorship

Not Available

RelocationAllowed
Skills
Python
SQL
Git
Azure
Spark
AWS
Pyspark
Apache Airflow
Databricks Workflows

About the job

Key Responsibilities

  • Build, maintain, and enhance scalable batch and near-real-time data pipelines using Python, SQL, and Spark/PySpark.
  • Integrate data from enterprise applications, operational systems, APIs, event streams, and AI inference outputs into reliable, analysis-ready datasets.
  • Develop transformations that combine structured and semi-structured data across sources using consistent identifiers and timestamps; handle time zones, duplicate records, and late-arriving events.
  • Create and maintain data models and curated datasets for business analytics, AI model development and evaluation, and AI-enabled application workflows.
  • Partner with AI/ML engineers to deliver data interfaces for inference workflows and capture model outputs, confidence scores, and user feedback for analysis and continuous improvement.
  • Implement data quality checks, reconciliation, pipeline monitoring, and alerting to ensure completeness, accuracy, freshness, and traceability.
  • Troubleshoot pipeline failures and performance issues; implement reliable retries, backfills, and incremental processing while optimizing compute and storage costs.
  • Collaborate with product managers, data scientists, analysts, and engineering partners to translate business requirements into practical data solutions.
  • Follow data security, privacy, access-control, and retention requirements when handling enterprise data and AI-generated outputs.
  • Write maintainable, tested code; participate in code reviews and CI/CD practices; document schemas, data lineage, dependencies, and operational runbooks.

Basic Qualifications

  • Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Engineering, Mathematics, Statistics, or a related quantitative discipline, or equivalent practical experience.
  • 3–5 years of relevant experience in data engineering or a closely related software engineering role.
  • Strong hands-on proficiency in Python and SQL, including complex queries, transformations, and troubleshooting.
  • Experience with Spark/PySpark and distributed data processing.
  • Experience building and supporting ETL/ELT pipelines on a cloud platform such as Azure or AWS.
  • Understanding of data modeling, relational databases, data lakes, data warehouses, and incremental processing patterns.
  • Experience with workflow orchestration tools such as Apache Airflow or Databricks Workflows.
  • Familiarity with event-driven or streaming data processing concepts, including event time, deduplication, and reliable delivery.
  • Experience with Git, automated testing, and production monitoring or troubleshooting.
  • Ability to independently deliver scoped work, communicate technical concepts clearly, and collaborate with technical and business stakeholders.

Extra Credit

  • Hands-on experience with Databricks, Delta Lake, or lakehouse architectures.
  • Experience with Databricks Asset Bundles / Declarative Automation Bundles to define, version, and deploy Databricks jobs and pipelines across environments through CI/CD.
  • Experience with streaming technologies such as Kafka, Azure Event Hubs, or Spark Structured Streaming.
  • Experience with retail, customer, inventory, or operational datasets.
  • Experience preparing datasets for machine learning, anomaly detection, or AI model evaluation.
  • Familiarity with multimodal data, unstructured data processing, or time-based event correlation.
  • Exposure to edge-to-cloud data integration, containerized workloads, or infrastructure as code.

About the company

Resolve Tech Solutions company logo
Investment & tech solutions for real estate and cloud, AI, & SAP services501-1000 Employees
Company Location
Addison
Company Size
501-1000
Learn more about Resolve Tech Solutions image

Funding

AMOUNT RAISED
$350K
FUNDED OVER
1 round
Round
S
$350000
Seed - Apr 2021