Join us as we pursue our ground-breaking vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we are committed to our work, customers, having fun, and most significantly to each other’s success.
The Splunk Observability Cloud provides full-fidelity monitoring and fixing across infrastructure, applications, and user interfaces, in real-time and at any scale, to help our customers keep their services reliable, innovate faster, and deliver great customer experiences. Infrastructure Software Engineers at Splunk are cloud-native systems engineers who use infrastructure-as-code, microservices, automation, and efficient design to build, operate, and scale our products.
**Role**
You will help us run one of the largest and most sophisticated cloud-scale, bigdata, and microservices platforms in the world. You will be responsible for enabling developers to operate highly available, scalable, and cost-efficient applications with low operational burden by handling and improving the reliability and resiliency of SRE-managed services and infrastructure. You thrive on automation, infrastructure-as-code, reliability engineering, and getting rid of tedious, manual tasks.
**You will:**
+ Work in _Splunk Cloud Observability_ in _FedRAMP_ environments.
+ Work across the organization to deliver quality products that delight _Splunk_ 's passionate users.
+ Work with teams of tight-knit engineers who are building a state-of-the-art, _cloud_ -based environment for massive-scale data processing.
+ You enjoy making other teams successful and are fulfilled through the success of others.
**Work on reliability projects, including:**
+ HA, Business Continuity Planning, disaster recovery, backup/restore, RTO, RPO
+ Chaos engineering
+ Application uptime and performance
+ Capacity management & planning
+ SLIs, SLOs, error budgets, and monitoring dashboards
+ Responsible for deployment and operations of large-scale distributed data stores and streaming services
+ Establishing design patterns for monitoring and benchmarking
+ Establishing and documenting production run books and guidelines for developers
+ Tooling, toil reduction, runbooks & automation to handle production environments
+ Incident management and improving MTTD/MTTR for services
+ Cloud cost optimization
**Qualifications**
**Must-Have:**
+ 3+ years of experience in handling large-scale cloud-native microservices platforms.
+ 1+ years of strong hands-on experience deploying, handling, and monitoring large-scale Kubernetes clusters in the public cloud specifically AWS or GCP
+ Experience with infrastructure automation and scripting using Python and/or Golang.
+ Experience developing, deploying and maintaining production services using an object-oriented programming language such as Java, C++, or Python.
+ Hands-on experience in monitoring tools such as Splunk, Prometheus, Grafana, ELK stack, etc. in order to build observability for large-scale microservices deployments.
+ Strong problem-solving, triaging, and debugging skills in large-scale distributed systems
**Preferred:**
+ Experience with deployment, operations, and performance management of one or more of the following large-scale clusters such as Cassandra, Kafka, Elastic Search, MongoDB, ZooKeeper, Redis, etc.
+ AWS Solutions Architect certification preferred.
+ Experience with Infrastructure-as-Code using Terraform, CloudFormation, Google Deployment Manager, Pulumi, Packer, ARM, etc.
+ Experience with CI/CD frameworks and Pipeline-as-Code such as Jenkins, Spinnaker, Gitlab, Argo, Artifactory, etc.
+ Proven skills to effectively work across teams and functions to influence the design, operations, and deployment of highly available software.
Bachelors/Masters in Computer Science, Engineering, or related technical field, or equivalent practical experience.
Please note: This position supports United States federal, state, and local government agency customers and is subject to certain U.S. citizenship-based restrictions imposed by law, regulation, executive order, government contract, and/or related determination by the U.S. Attorney General. As such, this position is contingent upon candidates establishing proof of U.S. citizenship status. If Splunk determines that a candidate’s citizenship status will prohibit the candidate from working in this position, Splunk expressly reserves the right to either consider the candidate for a different position that is not subject to such restrictions, on whatever terms and conditions Splunk shall establish in its sole discretion, or, in the alternative, decline to move forward with the candidate’s application.
Splunk is an Equal Opportunity Employer: Splunk, a Cisco company, is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.