Java Developer (API/Spark/Kafka)

Category: Software Development/ Engineering
Main location: Canada, Ontario, Toronto
Position ID: J0922-3094
Employment Type: Full Time

Position Description:

• Overall 7+ years experience in developing Microservices/APIs with 4 years in using Apache Spark- Must Have
• Experience in building scalable microservices using Spring Boot
• Expertise in following technologies
• Java with Spring Boot
• Creating services for real-time processing using Apache Spark, Kafka, NIFI, Spark Streaming
• Python or Scala, SQL and Shell scripting
• CI/CD pipelines using Jenkins, UCD, Nexus
• Knowledge on Big data technologies like Hadoop, Hive, HDFS

 Create components for data integration, data transformation etc.
 Build microservices and API for real-time data transfer and transformation using Sprint Boot and Kafka
 Create and execute automated unit tests
 Integrate the components/systems developed with the external SAAS solution
 Create build, test and release pipeline using CI/CD tool(Git, Jenkins, UCD)

Immediate tasks

A. Configure the development/integration environment
B. Use RBC Software Center to install approved tools
I. JDK 8 and 11
III. KAFKA (Confluent) or download (Community Edition Win64 Zip)
IV. Integrate Spring Boot Cloud to Eclipse
V. Install GIT
VI. Learn Inner Source (RBC source repository) and find potential reuse
A. Develop the POC micro service
B. Use the installed environment
I. Create an Eclipse sample test project for Kafka micro service integration (using Spring Boot Cloud) for both Consumer and Producer as a client
II. Configure the Confluence Connector for Workday existing system (find appropriate Connector)
III. Prepare data model (Topic and Schema) for two Workday tables (entity) e.g. Employee, Group
IV. Use ksql to JOIN two topics data and output result to a new topic
V. Use micro service from (i) to access new output topic, do some data transformation and output data to a new topic
VI. Create and execute Unit test for micro service"

#LI- MC1


  • Application Design
  • Application Development
  • Financial Services
  • Java
  • JavaScript
  • Spark SQL

What you can expect from us:

Insights you can act on

While technology is at the heart of our clients’ digital transformation, we understand that people are at the heart of business success.

When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes. We call our employees "members" because they are CGI shareholders and owners and owners who enjoy working and growing together to build a company we are proud of. This has been our Dream since 1976, and it has brought us to where we are today — one of the world’s largest independent providers of IT and business consulting services.

At CGI, we recognize the richness that diversity brings. We strive to create a work culture where all belong and collaborate with clients in building more inclusive communities. As an equal-opportunity employer, we want to empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.

Ready to become part of our success story? Join CGI — where your ideas and actions make a difference.