Data Engineer

Data Engineer at Revelio Labs, Inc., New York, NY (F/T)

JOB DUTIES: Own and scale the companys infrastructure platform with a focus on large-scale data systems, container orchestration, and infrastructure automation. Architect and maintain high-performance infrastructure supporting large-scale distributed databases and real-time processing systems. Manage and optimize Kubernetes clusters (both on-premise and in cloud environments), including multi-tenant isolation, resource allocation, security, autoscaling, and application monitoring. Develop and maintain Infrastructure-as-Code (IaC) with full GitOps integration. Manage cloud infrastructure on AWS, including IAM roles, VPC networking, S3 storage policies, and integration with containerized workloads and external services. Design secure and scalable interfaces between cloud-native infrastructure and data platforms. Collaborate with data engineers and machine learning teams to build scalable data pipelines. Provide hands-on development of ETL jobs and data transformation workflows. Provide expert guidance on high availability, sharding, scaling strategies, storage engine internals, and performance tuning for diverse workloads. Own the full observability stack, including the design and maintenance of monitoring, logging, and alerting systems. Track and optimize infrastructure costs through usage-based metrics, implementing cost-efficient monitoring strategies, and proactively identify areas to cut waste across compute, storage, and network resources.

JOB REQUIREMENTS: Position requires a Masters degree, or foreign equivalent, in Computer Science, Data Science, Data Analytics, Computer Engineering, or a closely related field, and completion of an internship (approx. 8-12 weeks) or equivalent experience. Full term of experience must include professional experience or internship experience in each of the following: Writing and debugging Python, Shell (Bash), and SQL code for use in infrastructure automation and data transformation workflows; Working with relational and NoSQL databases, including PostgreSQL and MySQL, to troubleshoot data issues, optimize query performance, and ensure data integrity for data pipelines; Implementing monitoring and troubleshooting processes to identify performance issues and ensuring data stability across infrastructure and data pipelines; Developing and maintaining CI/CD pipelines using GitHub Actions and YAML configurations to automate the building, testing, and deployment of Docker containers; and, Supporting cloud-based infrastructure by managing system configurations and updates through Git-based version control, containerization technologies, and laC.

Telecommuting permitted from any U.S. location.

SALARY: $160,000

$200,000 per year

QUALIFIED APPLICANTS: To apply, email resume to [email protected]. Reference: Rev-9510813.