In Levi9, we recognized the potential of projects related to big data processing as early as 2016. Consequently, we formed dedicated departments and roles within the company to focus on such projects. Our team currently consists of 10+ Data engineers with mixed seniorities. As the demand for data engineers is continuously growing, our teams are expanding. If you want to join experts in this field and are interested in data collection, processing, and visualization (sometimes in the order of petabytes) while implementing solutions on various cloud providers, this is the right place for you to apply.
Project, teams, requirements & duties
What you will be working on?
- Create and maintain optimal data pipeline architecture
- Establish and maintain the set of business reporting requirements.
- Research and validation of entity data using appropriate internal and external data sources
- Build the infrastructure required for optimal extraction, transformation, and loading of data using SQL and Azure ‘big data’ technologies.
- Work with data and analytics experts to strive for greater functionality in data systems.
What do we expect from you?
- Strong expertise in Python & PySpark
- Experience with Azure Databricks, Azure Data Factory, Azure SQL DB, and Azure Synapse
- Proficiency in designing efficient, robust, and automated data pipelines (ETL, data warehousing, Big Data processing)
- Experience with CI/CD pipelines for data engineering projects (preferably GitHub Actions)
- Knowledge of database design concepts and version control (Git)
- Ability to map business processes into data & analytics solutions
- Hands-on experience with Azure Data & Analytics services to build data pipelines, data streams, and system integrations
- Familiarity with preparing data for Data Science & Machine Learning applications
Collaboration & Leadership:
- Ability to evaluate business needs and align data solutions with stakeholder objectives
- Strong engagement with architects, data scientists, analysts, and peers
- Experience mentoring and coaching junior data engineers
Nice to have:
- Exposure to retail and/or market research domains
- Experience in cutting-edge data engineering innovations (e.g., improving data integration performance, enhancing data quality with new tools)
- Familiarity with Azure Functions and Storage Accounts
Our projects & stack: The application that you will work will be in python, Azure cloud/service, spark, etc. We are building data pipelines, data lakes, API service to support data scientist and BI reporting.
Our teams: Depending on the project, our teams consist of a mix of data engineers, DevOps engineers, and a delivery manager (scrum master), while the product owner is client-side. We use Scrum as a framework for project management – we hold daily standup meetings where every team member can have a say.
Your position in the organization: This position will be a part of one of our Data departments and your department manager will be there to guide you and support your career development.
What do we offer?
And much more! You will hear more details during the interview!
