Go Engineer - Intake Services Team

Distributed Locations: Australia Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale — unleashing the potential of businesses and people. The Elastic Search AI Platform, used by more than 50% of the Fortune 500, brings together the precision of search and the intelligence of AI to enable everyone to accelerate the results that matter. By taking advantage of all structured and unstructured data — securing and protecting private information more effectively — Elastic’s complete, cloud-based solutions for search, security, and observability help organizations deliver on the promise of AI.

What is The Role:

The Observability team is developing and providing solutions to application developers and engineers that run infrastructure and services supporting these applications. Elasticsearch is an efficient datastore for logs, metrics, application traces and profiling data. The Observability team builds and maintains solutions that make getting insights from this data turnkey and efficient, such as our APM, Infrastructure Monitoring, Logs and Universal Profiling solutions. When developing these solutions, we think about the problem end-to-end: how do we automatically collect data from common data sources, how do we store it efficiently in Elasticsearch, how do we present this information to the user, what actions do we take on the insights from the data? All of these aspects are important in bringing a turnkey solution to the market. As a Go Engineer in the Observability - Ingest - Intake Services team, you will be part of a team developing high quality observability products that are essential to the ingest flow of the Elastic Observability solution. The team’s main focus is on building and maintaining backend intake service components for cloud managed and on-prem deployments, and owning operational stability through extensive monitoring and SLOs. We have a focus on quality, performance, reliability, security and testability, as well as automation and continuous improvements. We build components and services that receive and validate signals from various edge collectors, such as Elastic APM, OpenTelemetry SDKs, as well as profiling agents, and transform them into Elasticsearch documents. The intake service components control the amount of data flowing into Elasticsearch and can buffer data temporarily without adding overhead to the edge applications using queues. We appreciate community contributions, and as such, engaging with the open source community is also an important part of this role. You’ll be collaborating with immediate team colleagues and across team boundaries. The team is diverse and distributed across the world, and collaborates on a daily basis over GitHub, Zoom, and Slack.

What You Will Be Doing:

• Design and implement new features for the observability intake services in Go.
• Maintain, update and improve existing code and dependencies while ensuring automated test coverage.
• Create and improve the development infrastructure using modern tooling such as Tilt and Terraform.
• Build a strong backend solution for the OpenTelemetry data flow.
• Design data formats for optimized data storage and query performance in Elasticsearch.
• Provide Pull Request reviews and guidance to your peers.
• Build SLIs (Service Level Indicators) and SLOs (Service Level Objectives) and participate in an on-call rotation for the services in the team’s ownership.
• Proactively participate in team conversations and contribute to a positive team culture.
• Collaborate with other parts of the company on cross-team features and topics.
• Collaborate with the support team on customer requests, engage with community via pull requests, issues, discuss forums.

What You Bring:

• A positive attitude and a curious mindset. Experience with Go programming language with strong analytical, debugging, troubleshooting skills. Interest in advanced topics such as memory management, benchmarking or profiling.
• Experience/knowledge in observability space (developing monitoring products; working with metrics & sampling strategies).
• Hands-on experience with Docker & Kubernetes.
• Ability to work independently in a globally distributed team while collaborating & sharing knowledge.

Bonus Points:

• Experience or interest in OpenTelemetry
• Experience developing high throughput low latency services
• Experience working with stream processing platforms like Apache Kafka or cloud provider managed queues
• Understanding how to design & implement SLOs
• Experience working with various cloud service providers
• Knowledge of Elasticsearch &/or Kibana
• Experience participating in technical decision-making across different engineering teams

Additional Information - We Take Care of Our People:

As a distributed company diversity drives our identity. Whether launching or growing your career Elastic offers balance between great work & life. Age does not matter; we value what you can do. We strive for parity of benefits across regions despite regulatory differences:

• Competitive pay based on your work here (not previous salary)
• Health coverage for you & family in many locations
• Flexible locations & schedules for many roles
• Generous vacation days annually
• Match up to $2000 (or local currency equivalent) for financial donations & service
• Up to 40 hours yearly toward volunteer projects you love
• Minimum 16 weeks parental leave embracing parenthood

Elastic is an equal opportunity employer committed to inclusive culture celebrating diverse perspectives/experiences/backgrounds. Qualified applicants considered without regard to race/ethnicity/color/religion/sex/pregnancy/sexual orientation/gender identity/national origin/age/marital status/protected veteran status/disability or other protected basis by law. We welcome individuals with disabilities striving for accessible inclusive experience; accommodation requests during application/recruiting process can be emailed to candidate_accessibility@elastic.co (response within 24 business hours). Elasticsearch technology subject to U.S. & other country export controls/licensing requirements related to nationals located in sanctioned countries: Belarus,Cuba,Iran,N.Korea,Russia,Syria,the Crimea Region of Ukraine,DNR,LNR. Export license may be required conditionally; national origin/nationality does not affect employment eligibility. Privacy Statement link provided. Apply Now (Job ID: R10851)