Sr Big Data Engineer (GCP) at Rackspace

Rackspace logo
Rackspace

Sr Big Data Engineer (GCP)

us flag
United States

Remote

Full Time

#Kafka

#Kinesis

#Flink

#Dataflow

#Pub Sub

Rackspace is looking for a Sr Big Data Engineer (GCP)
About the Role:We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively.
What you will be doingBuild a reusable, and reliable code for stream and batch processing systems at scale. This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc.

Requirements:

  • Experience in building a reusable, and reliable code for stream and batch processing systems at scale.
  • Expertise in public cloud services, particularly in GCP.
  • Experience with GCP managed services and understanding of cloud-based messaging/stream processing systems are critical.
  • Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.
  • Has knowledge in containerization technologies such as Docker and Kubernetes to enhance the scalability and efficiency of applications.
  • Ability to tackle complex challenges and devise effective solutions. Use critical thinking to approach problems from various angles and propose innovative solutions.
  • Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals.
  • Proven experience in engineering stream/batch processing systems at scale.
  • Strong programming abilities in Java and Python.
  • Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.

Must Have:

  • Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification
  • 4+ years of experience in customer-facing software/technology or consulting
  • 4+ years of experience with “on-premises to cloud” migrations or IT transformations
  • 4+ years of experience building, and operating solutions built on GCP (ideally) or AWS/Azure
  • Technical degree: Computer Science, software engineering or related

About Rackspace TechnologyWe are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future. More on Rackspace TechnologyThough we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.
Rackspace logo

Rackspace

1 views

0 applied

Markets

Cloud Computing
Hosting
Professional Services
IaaS
Visit Rackspace
Share this job
Copy Permalink
Open roles at Rackspace
Rackspace logo
Rackspace

Rubrik Storage and Backup Engineer

Remote

Full Time

#Product

#Storage

#Fiber

#Networking

#Windows

#Active Directory

#VMWare

Rackspace logo
Rackspace

Customer Data Engineer

Remote

Full Time

#Cloud

#Product

#MongoDB

#Elasticsearch

#Linux

#Ansible

#Shell Scripting

#Python

#Configuration Management

#Troubleshooting

Rackspace logo
Rackspace

Frontend Engineer

in flag
India

Hybrid

Full Time

#Cloud

#Product

#HTML

#CSS

#JavaScript

#TypeScript

#React

Rackspace logo
Rackspace

Low Code Developer

Remote

Full Time

#Product

#Microsoft Office

#Amazon Web Services

#Programming

#APIs

Rackspace logo
Rackspace

Software Developer

Remote

Full Time

#Cloud

#Product

#Linux

#Python

#JavaScript

#Docker

#Ansible

#Terraform

#Git

#Network Fundamentals

#Agile Methodologies

Rackspace logo
Rackspace

Software Developer III

Remote

Full Time

#Cloud

#Product

#Linux

#Python

#JavaScript

#Docker

#Ansible

#Terraform

#Git

#Network Fundamentals

#Project Management

Rackspace logo
Rackspace

DevOps Engineer

Remote

Full Time

#Cloud

#Product

#CI CD

#Jenkins

#Docker

#Kubernetes

#Terraform

#Ansible

#Linux

#AWS

#Python

#Git

Rackspace logo
Rackspace

Manager, Software Development

Remote

Full Time

#Cloud

#Product

#Python

#Golang

#NodeJS

#Java

#DevOps

Rackspace logo
Rackspace

Manager, Technical Support – OpenStack with Kubernetes

Remote

Full Time

#Product

#OpenStack

#Kubernetes

#CRM

#SLA

#Customer Service

#Change Management

#Management

#Engineering

#Leadership

Rackspace logo
Rackspace

Manager, Technical Support – OpenStack with Kubernetes

Remote

Full Time

#Product

#OpenStack

#Kubernetes

#CRM

#SLA

#Customer Service

#Service Delivery

#Change Management

#Management

Discover similar jobs
U
UNION

Sales Engineer

Remote

Full Time

#Sales

#Infrastructure

#Machine Learning

#Data Processing

#MLOps

#PyTorch

#TensorFlow

#Spark

#Flink

#AWS

#GCP

#Azure

#Terraform

#Docker

#Kubernetes

Sift logo
Sift

Software Engineer

Remote

Full Time

#Fraud Detection

#Infrastructure

#Platform Engineering

#Java

#Python

#Terraform

#Kubernetes

#GCP

#AWS

#Kafka

#Jenkins

#Docker

#Spark

A
Addi

Backend Software Engineer

Remote

Full Time

#Backend Engineering

#Fintech

#Lending

#Java

#Kotlin

#Spring Boot

#PostgreSQL

#Redis

#Docker

#Kubernetes

#Kafka

#SQS

#Automated Testing

Acceldata logo
Acceldata

Site Reliability Engineer

in flag
India

On-site

Full Time

#Customer Success

#Support

#Hadoop

#HDFS

#Yarn

#Hive

#Kafka

#NiFi

#Manager

#Linux

Asapp-2 logo
Asapp-2

Lead Machine Learning Engineer

us flag
United States

Hybrid

Full Time

#Technology

#Engineering

#NLP

#Machine Learning

#Systems

#Python

#AWS

#Kubernetes

#Docker

#CI CD

#Kafka

#Athena

F
Financial Times

Backend Engineer - Content & Metadata

bg flag
Bulgaria

On-site

Full Time

#Business

#Content

#Technology

#Go

#Kubernetes

#AWS

#MongoDB

#PostgreSQL

#Neo4j

#Kafka

#Elasticsearch

#Microservices

#Cloud Infrastructure

O
OpenTag

Junior Golang Developer

bg flag
Bulgaria

On-site

Full Time

#Gaming

#Software

#IT

#Golang

#OOP

#REST APIs

#Git

#SQL Databases

#Docker

#Kafka

#RabbitMQ

#gRPC

H
Helpscout

Senior Java Kotlin Engineer - Search

Remote

Full Time

#Engineering

#Java

#Kotlin

#Elasticsearch

#Clickhouse

#Kafka

#Flink

#RabbitMQ

#MySQL

#PostgreSQL

D
Decathlon Digital FR

SAP Engineering Manager

fr flag
France

Hybrid

Full Time

#Engineering

#Supply Chain

#Product Development

#SAP

#Kafka

#Governance

#Data Governance

K
Klaviyo Campus

Software Engineer I

us flag
United States

104k - 156k USD

On-site

Full Time

#Engineering

#Python

#Django

#TypeScript

#React

#MySQL

#Cassandra

#Clickhouse

#Kafka

#Redis

#Amazon Web Services

B2C2 logo
B2C2

KDB Developer

gb flag
United Kingdom

Hybrid

Full Time

#Digital Assets

#Financial Technology

#Data Analytics

#Linux

#Bash Scripting

#Market Data

#Big Data

#Continuous Integration

#Python

#Java

#Kafka

#Docker

I
ICE

Senior Frontend Engineer – Usage Ingestion

gb flag
GB, ES

Hybrid

Full Time

#Technology

#Frontend

#React

#Redux

#TypeScript

#Material UI

#Test Driven Development

#Git

#AWS

#Pulumi

#Kafka

#Protobuf

J
JUMO

Senior Data Engineer

Remote

Full Time

#Financial Services

#Big Data

#Technology

#Spark

#Kafka

#Python

#SQL

#Airflow

#AWS

#Docker

#Kubernetes

#Data Pipeline

#CI CD

NOWATCH logo
NOWATCH

Senior Backend Data Engineer

nl flag
Netherlands

Hybrid

Full Time

#Product

#Health Tech

#Python

#Docker

#Kubernetes

#Kafka

#Spark

#Flink

#AWS

#PostgreSQL

#NoSQL

D
Dune

Data Engineer

Remote

Full Time

#Engineering

#Blockchain

#Data

#SQL

#Python

#Prefect

#Airflow

#Snowflake

#Kafka

#BigQuery

#Databricks

#Kubernetes

G
Gorgias

Senior Backend Engineer

fr flag
France

On-site

Full Time

#Customer Service

#E Commerce

#Software

#Python

#Java

#Kafka

#Pub Sub

#API Design

Morningbrew logo
Morningbrew

Data & Analytics Engineer

150k - 170k USD

Remote

Full Time

#Product

#Data

#SQL

#DBT

#Python

#Snowflake

#BigQuery

#Redshift

#Fivetran

#Airflow

#Kafka

V
Vinted

Backend Engineer, Group Security

lt flag
Lithuania

43k - 81k USD

Hybrid

Full Time

#Engineering

#Cyber Security

#Software

#Python

#Go

#Ruby

#Scala

#Redis

#MySQL

#Prometheus

#Grafana

#Kafka

#Kubernetes

T
TripleLift

Senior Data Engineer

in flag
India

On-site

Full Time

#Advertising

#Data Engineering

#Technology

#Spark

#Python

#Java

#Scala

#SQL

#AWS EC2

#AWS

#NoSQL

#Kafka

#Airflow

SovTech logo
SovTech

Senior GCP Data Engineer

za flag
South Africa

On-site

Contractor

#Engineering

#Google Cloud

#Terraform

#Python

#SQL

#BigQuery

#Cloud Storage

#Dataflow

#Cloud Functions

#Cloud Composer

#dataform

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.