Exceptional Senior Data Engineer

About Aiobis
Aiobis is revolutionizing business interactions with our cutting-edge All-In-One Business Interaction Suite. We're building a comprehensive platform that consolidates essential business tools into a seamless, secure, and efficient solution. Our platform processes and manages vast amount of business data, making it crucial to have robust data infrastructure and governance.

The Opportunity
We're seeking an exceptional Senior Data Engineer to architect and implement the data infrastructure powering Aiobis's core capabilities. This is a unique opportunity to work with massive datasets and build scalable data pipelines that will support our global B2B and firmographic data platform. You'll be responsible for designing and implementing data systems that handle billions of data points while ensuring compliance with ISO27001, SOC II, GDPR and other relevant data security and compliance standards.

Key Responsibilities

• Design and implement scalable data pipelines to process and maintain our billions of records
• Architect and optimize data storage solutions for efficient querying and real-time access
• Develop and maintain ETL processes for continuous data ingestion from multiple sources
• Implement data quality checks and monitoring systems to ensure data accuracy and reliability
• Design and maintain data warehousing solutions that support our analytics and machine learning needs
• Ensure data compliance with ISO27001, SOC II, GDPR, and other relevant standards
• Build systems to support our patent-pending privacy-preserving prospecting mechanism
• Create and maintain data documentation and governance policies
• Collaborate with ML engineers to build efficient data pipelines for model training and inference
• Optimize data infrastructure for performance and cost efficiency

Required Qualifications

• 5+ years of experience in data engineering, with proven experience handling large-scale datasets
• Strong expertise in building and optimizing data pipelines, ETL processes, and workflows
• Proficiency in SQL and NoSQL databases (PostgreSQL, MongoDB, Cassandra)
• Experience with big data technologies (Hadoop, Spark, Kafka)
• Strong programming skills in Python, Scala, or Java
• Experience with cloud platforms (AWS, GCP, or Azure) and their data services
• Knowledge of data warehousing concepts and technologies (Snowflake, Redshift, BigQuery)
• Understanding of data security and compliance requirements
• Experience with data modeling and schema design
• Proficiency with version control systems and CI/CD pipelines

Preferred Qualifications

• Experience with real-time data processing systems
• Knowledge of privacy-preserving technologies and techniques
• Familiarity with graph databases and processing
• Experience with data governance and metadata management
• Understanding of machine learning pipelines and requirements
• Contributions to data engineering open-source projects
• Experience with data quality monitoring and observability tools
• Knowledge of distributed systems and microservices architecture

What We Offer

• Opportunity to work with one of the largest B2B datasets in the industry
• Competitive compensation including equity package
• Remote-first work environment with flexible hours
• Access to cutting-edge data tools and technologies
• Collaborative and innovative team culture
• Regular knowledge sharing and learning opportunities
• Rapid growth and career advancement possibilities

The Challenge
As a Senior Data Engineer, you'll be instrumental in building and scaling our data infrastructure to support our ambitious launch and grow timeline. You'll need to balance data accessibility with privacy requirements, implement efficient data pipelines that can handle billions of records, and ensure our systems maintain high performance while meeting strict compliance standards.

If you're excited about building scalable data systems that power the future of business interactions, we want to hear from you!

To apply, please send your resume, a brief description of your most challenging data engineering project, and any relevant links (GitHub, portfolio, etc.) to [email protected].

Aiobis is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.