Python Performance Specialist

Python Performance Specialist

Categoría: Desarrollo / Ingeniería
Ciudad: London, England - London, United Kingdom
ID de Posición: J0221-2958
Tipo de empleo: Jornada Completa

Descripción de la publicación:

If you have a sixth sense for data science, there’s a digital revolution underway in the UK that needs the talents of people who are at home analysing, managing, designing and predicting complex datasets and breathing life into AI systems.

We need a Python Performance Specialist to join our financial services team tasked with working with our Investment Baking clients

From public service transformation to cutting-edge commercial projects, our work has a wide reach, helping make the everyday easier, for everyone. When you start your CGI story, not only will you be improving people’s lives, you can be sure we’ll do the same for you.

Alongside a competitive salary, we offer you our share scheme (3% + 3% matching) making you a member not just an employee. You also have the option to benefit from private medical and dental insurance, flexible retirement options, childcare vouchers and a cycle to work scheme.

As for the future? We work as one team, and are a Top 100 employer. Be a successful part of our story and we’ll support you in taking your career anywhere you want it to go.

Sus futuros deberes y responsabilidades:

• Producing clear & concise metrics on proposed solutions i.e. before/after picture.
• You will be using the Spark shell to prototype, validate and demonstrate changes.
• To design and develop code with performance optimization, extensibility and maintainability in mind.
• Overseeing Spark implementations with a focus on performance tuning e.g. looking at the DAG.
• Experience of implementing efficient solutions for memory, CPU and file I/O processing once data has landed on HDFS
• Contributes to problem and root cause analysis.
• Collaborates with colleagues participating in other stages of the Software Development Lifecycle (SDLC).

Calificaciones requeridas para tener éxito en este rol:

• Fundamentals of Spark using the Dataframe API
• Strong understanding of how the spark engine is architected and how spark is used i.e. sparksql, pyspark, map reduce, etc.
• Strong understanding of performance techniques e.g. performance implication such as disk load, data partitioning.
• Hand-on experience of overseeing Spark implementations with focus on performance tuning e.g. looking at the DAG.
• Experience of ETL and Batch Processing (Streaming experience NOT required)
• Experience of implementing efficient solutions for memory, CPU and file I/O processing once data has landed on HDFS
• Knowledge of Hadoop and its ecosystem of technologies especially Hive
• Someone who does not require constant direction but is able to work independently and produce robust designs that stand up to scrutiny
• Hands on Python/PySpark/Sparksql
• OOP concepts using Python
• Contributes to quality assurance by writing unit and functional tests.
• Basic knowledge of UNIX
• Demonstrate source control knowledge (preferably GIT)
• The ability to analyse databases directly using query language tools such as SQL
• Experience on ETL process on Big Data
• An understanding of data relationships, normalisation as well as a good understanding of Big Data architecture
• Ability to interpret and write complex SQLs
• Use of JIRA / Confluence
• Appreciation of release management and software maintenance
• Contributes to problem and root cause analysis.
• Collaborates with colleagues participating in other stages of the Software Development Lifecycle (SDLC).
• Strong analytical skills.
• Ability to work in virtual teams
• Excellent team player and open minded approach
• Ability to share information, transfer knowledge and expertise to team members.
• Ability to work in a fast paced environment with competing and alternating priorities with constant focus on delivery.
• Knowledge of control M
• Hands on experience of Team City
• Understanding of Financial Products is desirable

This role will ideally be based in London, but we willing to consider candidates based near other CGI offices across the UK.

#INDCGI

¿Qué esperas de nosotros?:

Build your career with us.

It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change—supporting our clients’ digital journeys and offering our professionals exciting career opportunities.

At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.

Be part of building one of the largest independent technology and business services firms in the world.

Learn more about CGI at www.cgi.com.

No unsolicited agency referrals please.

CGI is an equal opportunity employer.