Data Engineer - Spark SQL

Data Engineer - Spark SQL

Categoría: Analytics y Tecnologías Digitales Emergentes
Ciudad: London, England - London, United Kingdom
ID de Posición: J0221-2959
Tipo de empleo: Jornada Completa

Descripción de la publicación:

If your programming skills are matched by an enthusiasm for problem-solving, and your communication skills are as creative as your coding, there’s a digital revolution underway in the UK that could use your help.

Our Financial Services business unit is looking to add a couple of talented Spark SQL Developers to a programme of work with one of or key Investment Banking clients.


From public service transformation to cutting-edge commercial projects, our work has a wide reach, helping make the everyday easier, for everyone. When you start your CGI story, not only will you be improving people’s lives, you can be sure we’ll do the same for you.

Alongside a competitive salary, we offer you access to our share scheme (3% + 3% matching) making you a member not just an employee. You also have the option to benefit from private medical and dental insurance, flexible retirement options, childcare vouchers and a cycle to work scheme.
As for the future? We work as one team, and are a Top 100 employer. Be a successful part of our story and we’ll support you in taking your career anywhere you want it to go.

This role can be based out of our London office as well as other CGI offices.

Sus futuros deberes y responsabilidades:

Working on a large programme of work within an Investment you will have a number of responsibilities including:
• Contributes to quality assurance by writing unit and functional tests.
• Ensures development happens for all Software Components in accordance with Detailed Software Requirements specification, the functional design and the technical design document.
• Designing and writing code in accordance with provided business requirements
• Analysing and performance tuning Spark queries e.g. looking at the DAG
• You will be developing source code, including descriptions in line with detailed requirements, then verifying the developed source code by reviews in addition to measuring and analysing code for quality
• Analysing databases directly using query language tools such as SQL. We also require you to interpret and write complex SQLs
• Integrating software components including unit and integrated software testing according to the test plan
• Ensuring that all code changes, end up in configuration and deployment tools
• Providing Release Deployments on non-Production Management controlled environments
• Providing Level 3 support for technical components and contributing to problem and root cause analysis
• Collaborating with Functional Analysts and technical Specialists to complete work

Calificaciones requeridas para tener éxito en este rol:

• You must have excellent experience with the Fundamentals of Spark using the Dataframe API
• Understanding partitioning of data
• Experience of Analysing and performance tuning Spark queries e.g. looking at the DAG
• Knowledge of Hadoop and its ecosystem of technologies especially Hive
• You must have the ability to interpret and write complex SQLs
• You must have excellent expertise with SQL fundamentals including aggregation and joins and an ability to analyse databases directly using query language tools such as SQL. We alsoe require you to be able to interpret and write complex SQLs
• Basic knowledge of UNIX
• Able to demonstrate source control knowledge (preferably GIT)
• Experience with ETL process on Big Dat
• An understanding of data relationships, normalisation

Non-Technical
• Use of JIRA / Confluence
• Appreciation of release management and software maintenance
• Strong analytical skills.
• Should have good understanding of architecture
• Ability to work in virtual teams
• Excellent team player and open minded approach
• Ability to share information, transfer knowledge and expertise to team members.
• Ability to design and write code in accordance with provided business requirements
• Ability to work in a fast paced environment with competing and alternating priorities with constant focus on delivery.
• Candidate is expected to have high desire to learn new technologies and implement various solutions in fast paced environment

Desirable skills:
• Knowledge of control M
• Hands on experience of Team City
• Understanding of Financial Products


#INDCGI

¿Qué esperas de nosotros?:

Build your career with us.

It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change—supporting our clients’ digital journeys and offering our professionals exciting career opportunities.

At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.

Be part of building one of the largest independent technology and business services firms in the world.

Learn more about CGI at www.cgi.com.

No unsolicited agency referrals please.

CGI is an equal opportunity employer.