Data Engineering Consultant

Category: Analytics and Emerging Digital Technologies
Main location: Canada, Saskatchewan, Regina
Position ID: J0324-1235
Employment Type: Full Time

Position Description:

Ready to join an outstanding culture that cares about diversity and inclusion, corporate social responsibility, and gives the freedom to innovate, influence decisions, and chart an exciting career?
CGI is more than just an IT company. Be part of a hardworking team that supports the local community with the ability to draw on global best-in-class talent! Benefits include a share purchase program, profit sharing, wellness credits, training/development programs, and flexible work schedules.
We are looking for a Data Engineer to join our winning team. Become part of an outstanding culture that gives you the freedom to innovate, influence decisions, achieve your full potential, and chart your own career. In this role you will build cloud analytics solutions to solve any challenge that our customers might face.
You could be described as a multipurpose Swiss army knife in a modern analytics world where noSQL meets SQL and real time & batch processes are complementing each other. Your toolbox is a solid combination of hacker abilities merged with SQL developing + ETL + Linux + Python or comparable programming skills.
You will find your way into our customer’s sensor systems, stream the data into a cloud platform, and make sure the data is available for real time automation via efficient API-layer.
You plan and configure the cloud analytic solution to support the customer specific needs in the best way. You do not have to be an expert in all these areas yet, but you will be on a good way, as soon as you join our team.

Your future duties and responsibilities:

• Cloud platform setup and implementation of data integrations towards cloud platform
• Create and support analytical data infrastructure by gathering, processing, analyzing, and structuring large volumes of data from many structured and unstructured data sources, at scale.
• Design, develop and implement highly scalable, repeatable, and secure data pipelines and transformation processes.
• Design and build transformation models and data flows for batch, real-time, and complex event-driven processes.
• Develop data ingest processes across a variety of third-party APIs, applications, and file stores.
• Ensure that appropriate controls are in place and all in-motion and at-rest data is secured at all times.
• Develop data catalogs and data validation scripts to ensure data accuracy, clarity, and correctness of key business metrics.
• Employ proper data governance to ensure data security and integrity.
• Research and make recommendations for new data management technologies and software engineering practices. Collaborate on decisions around the use of new tools and practices.
• Provide guidance to a customer and project team with respect to data requirements, data gaps, and the level of effort required to deliver a solution.
• Produce and maintain support documentation and data dictionaries.

Required qualifications to be successful in this role:

• Strong experience with at least one cloud platform: AWS, Azure and/or GCP
• Knowledge and some experience with Infrastructure as Code (Terraform or Cloud native like Cloudformation or ARM)
• Experience with DevOps and some version of agile.
• Experience with data ecosystem tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Snowflake, Hadoop, Spark, etc.
• Experience working with SQL, PowerBI, and or other query and reporting tools.
• Experience using scripting languages such as Python, Scala, Spark, Spark-Streaming, and Kafka.
• Knowledge of modern software development techniques and methodologies.
• Knowledge and practice of secure software development processes.
Attributes:
• Ability to handle multiple priorities and deadlines.
• Self-directed and comfortable supporting the data needs of multiple teams and projects.
• Value teamwork and urgency with a passion for driving impact.
• Excellent written and verbal communication skills, with the ability to effectively communicate with a broad range of constituents.
• Passionate for turning disparate streams of data into organized and actionable analytics programming acumen, competency in manipulating large volumes of data, and a solid knowledge of a broad range of technologies for data processing and modeling.
• Up-to-date with the latest technology trends and have a strong desire to constantly learn.
• Love solving complex problems and have expertise in world-class data pipelines, from batch to real-time implementations.
• Demonstrable ability to navigate between the big-picture and implementation details.
Education:
• Bachelor’s degree or diploma in mathematics, informatics, statistics, computer science, or information systems (or equivalent combination of skill and experience).

#LI-AP1

Skills:

  • Apache Kafka
  • Azure Data Factory
  • DevOps
  • MS SQL Server
  • Python
  • Scala
  • Spark SQL

What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.