Systems Engineer (Expert+)

Part of a team responsible for building and operating a hybrid-cloud mission infrastructure and services, hosting dozens of Commercial off the Shelf (COTS), Government off the Shelf (GOTS), and custom applications, as well as a large data lake. The system has on-premises components deployed at multiple data centers, as well as use of commercial cloud resources. The Sponsor seeks Systems Engineering support with a diverse background in monitoring tools and strong technical skills to facilitate and document systems deployments across the environment. The team will work in a 24 hour, 7 day a week environment providing in-depth Tier 2 through Tier 4 level support and problem resolution for technology products and applications.

Required Skills & Demonstrated Experience

Experience and skills with building monitoring dashboards and alerts on windows and linux systems.

Experience and skills using common data models, data patterns, and data governance.

Experience creating Splunk and other COTS monitoring tool customer queries, reports, and alerts.

Experience implementing knowledge objects, lookups, and data models using common data model patterns.

Experience writing in multiple scripting languages, python, bash and powershell.

Experience working with various monitoring software on a Linux platform.

Experience working with various monitoring software on a Windows platform.

Experience working with various monitoring software’s in the cloud and on prem environments.

Experience performing complex systems development such as design, implementation, and administration for enterprise-based systems monitoring and alerting systems such as CheckMK, Nagios, and SolarWinds.

Experience performing complex systems administration and maintenance for enterprise auditing and logging systems.

Experience performing complex systems administration and maintenance for large-scale Splunk systems including search heads, indexes, forwarders, and agents.

Experience performing ETL tasks to ensure data is loaded into Splunk accurately.

Experience performing complex queries and searches with Splunk and creating Splunk dashboards to clearly and accurately convey complex data.

Experience with shell scripting or interpreted languages such as Python or PowerShell.

Experience analyzing existing systems and identifying necessary corrective actions and improvements.

Desired Skills & Demonstrated Experience

Experience creating and presenting system documentation briefings to review and approval boards.

Experience performing tier 2 thru tier 4 support, including both systems troubleshooting and incident tracking and management.

Certifications: