- Top 5% of respondersSKM Group is in the top 5% of companies in terms of response time to applications
- Responds within a few daysBased on past data, SKM Group usually responds to incoming applications within a few days
Senior Data Engineer with Blockchain
- €54k – €120k • No equity
- Remote •+39
- 5 years of exp
- Full Time
Not Available
Onsite or remote
About the job
We are a software house with a 15-year history, a rich portfolio, projects all over the world and an appetite for more. We have built our brand on professionalism and flexibility in delivering software solutions. We are not afraid of unconventional ideas and value innovation and imaginative change.
We are currently looking for an experienced and highly skilled Senior Data Engineer with Blockchain to support the development of a blockchain crypto solution. The application allows audit teams to verify assets of their clients, like crypto currencies. You will play a crucial role in managing and leveraging large datasets, ensuring data integrity, and supporting their blockchain audit related tasks.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, PySpark and Databricks.
- Implement data orchestration workflows using Airflow or similar tools.
- Manage and optimize data storage solutions on Azure Cloud.
- Develop and maintain containerized microservices using Docker.
- Collaborate with cross-functional teams to ensure data quality and integrity.
- Support the setup of blockchains.
- Build tools to acquire data from blockchains and perform analysis on the data using Databricks.
- Support production infrastructure, including monitoring and automation using tools like Datadog.
- Participate in agile development practices, contributing to planning exercises and working in cross-functional groups.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
- Advanced Python knowledge for data processing and scripting.
- Proven experience with Spark and SQL for data engineering and analysis.
- Experience with data orchestration tools like Airflow.
- Hands-on experience with one or more cloud services (Azure, AWS, GCP).
- Proficiency in RDBMS/NoSQL data stores and appropriate use cases.
- Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, packaging, familiarity with containerization tools such as Docker (must have) and Kubernetes (plus).
- Solid understanding of the software development life cycle.
- Understanding of blockchain technologies and data structures.
- Knowledge of cryptography and its application in blockchain is a plus.
- Experience with blockchain indexing is a plus.
- Experience with Databricks for data ingestion and transformation is a plus.
- Familiarity with Delta Lake and data warehousing concepts is a plus.
- Strong communication, interpersonal and presentation skills.
- Excellent communication and interpersonal skills, fluent English.
What do we offer you?
- Attractive salary
- Large freedom and real influence
- No unhealthy competition, team approach to meeting challenges
- Remote or hybrid work model
- Company apartments in cool cities across Europe: work and enjoy a memorable getaway
We rely on people who want to create something new and improve our client's solutions. If you value a good atmosphere and the spirit of cooperation, you will fit in here.
About the company
- Top 5% of respondersSKM Group is in the top 5% of companies in terms of response time to applications
- Responds within a few daysBased on past data, SKM Group usually responds to incoming applications within a few days