Descrição da Função:
Ready to join an outstanding culture that cares about diversity and inclusion, corporate social responsibility and enables the freedom to innovate, influence decisions, and chart an exciting career?
CGI is more than just an IT company. Join a team that supports the local community with the ability draw on global best-in-class talent! Benefits include a share purchase program, profit sharing, wellness credits, training and development programs, and flexible work schedules and locations.
CGI is looking for a Senior Data Engineer for its growing team in Western Canada, to help our customers on their digital transformation journey!
This position is ideal for someone who is looking to take on a challenging role in delivering complex data engineering for AI, machine learning, and analytic solutions on various cloud platforms with clients. The successful candidate will demonstrate a breadth of understanding established and emerging data engineering technologies and experience. Experience with complex data integration, DevOps, DataOps, big data processing, predictive analytics, and data visualization in the energy industry are expected.
Os teus futuros deveres e responsabilidades:
We help our clients with numerous types of projects covering a variety of different business scenarios including supporting data for business intelligence, data governance and management, customer relationship management, asset management, and enterprise resource planning. The data engineer will have the skills to communicate and deliver modern data engineering products to solve different business problem while building close relationships with both client and CGI team members:
Develop new systems to provide real-time streaming analytics and event processing pipeline based on high velocity data architecture to handle throughput over millions of events per second
Develop enterprise grade data lake to support both business analytical needs and next generation data infrastructure
Develop data integration toolkit to build and manage automated and efficient data pipelines that will consume data from backend services into data repositories and various formats to be consumable by reporting systems and analysts
Participate in creating and implementing DataOps, DevOps, and CICD best practices
Support data science teams in developing and deploying new algorithms
Create infrastructure to monitor and manage data integrity and data systems health
Leverage and contribute to industry best practices including proper use of source control, code reviews, data validation and testing
Create and implement engineering best practices and collaborate in the design of effective streamlined processes with partner teams
Qualificações requeridas para ser bem sucedido neste role:
5+ years of experience in data management, data engineering and/or software engineering working with SQL, Python, Scala, Java, Databricks, Snowflake/Snowpipes, Azure Data Factory, Informatica, AWS Pipelines, and Cloud technologies (Azure, AWS, or GCP)
Experience designing, implementing, automating and maintenance of large-scale data pipeline processes, providing proficiency with concepts like idempotency, retry and backoff strategies, data parsing techniques, invalid data handling, data staging, code reuse
Experience in developing containerized data applications and hosting data systems in container orchestration platforms like Kubernetes.
Experience deploying data infrastructure
Experience in a DataOps, DevOps, CI/CD environment with technologies and platforms such as Git, Jenkins, Docker/Kubernetes, and others is an asset
Experience in rapidly prototyping a data product from scratch and leading the implementation in production.
Experience with recognized industry patterns, methodologies, and techniques assets
Experience working with RDBMS technologies including MySQL
Experience with data warehousing technologies (SQL Server, Snowflake and/or Redshift)
Experience with infrastructure including Azure & AWS (S3, Gen2 Data Lake, CloudWatch, Monitor, RedShift, Synapse, CloudFormation, Resource Manager), Terraform, Kubernetes, Docker, Bazel
Experience with a broad range of data sources such as RESTful APIs, SOAP, XML, JSON, client stream, transactional, video, SCADA
Experience with ML stack, including PyTorch, Plotly / Dash, Parquet, DVC, and Dask
- Data Engineering
- Advanced Analytics
- Container Technology
- Data Analysis
- Data Warehousing
O que pode esperar de nós:
Insights you can act on
While technology is at the heart of our clients’ digital transformation, we understand that people are at the heart of business success.
When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes. We call our employees "members" because they are CGI shareholders and owners and owners who enjoy working and growing together to build a company we are proud of. This has been our Dream since 1976, and it has brought us to where we are today — one of the world’s largest independent providers of IT and business consulting services.
At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.
Ready to become part of our success story? Join CGI — where your ideas and actions make a difference.