Skip to main content
← Back to search
CA

Senior Software Engineer

Clearwater Analytics (CWAN)

Salary undisclosed

Pune (M.H)Full-timeOn-siteProficient

Need a reasonable accommodation to apply or interview? Contact us.

JobMinglr uses automated technology to recommend jobs based on profile information and job preferences. Match Score does not determine eligibility for a position, prevent a user from viewing or applying to a job, or make hiring decisions on behalf of an employer.

Description

JOB TITLE: Senior Security Data Engineer

   

EXPERIENCE: 5–10 Years

Approved Date:

REPORTS TO: Shivendra Ashish

Revised Dates:

POSITIONS SUPERVISED:

 

Core Responsibilities:

  • Pipeline Management: Maintain high-throughput streaming pipelines to ingest logs from various sources (Firewalls, Cloud, Endpoints) to a central destination.
  • Log Normalization: Write parsers to convert raw, messy logs into standard schemas (e.g., OCSF or ECS) for consistent querying.
  • Cost Optimization: Implement routing logic to send "high-value" data to the SIEM and "bulk" data to low-cost Object Storage (Data Lake).
  • Data Preparation: Clean and structure data to enable AI/ML detection models and advanced analytics.

 

Must-Have Skills:

  • Data Engineering: Proficiency in Python (for ETL) and SQL (for complex querying).
  • Streaming Tech: Experience with Message Queues (e.g., Kafka, Pub/Sub) and stream processing concepts.
  • Log Handling: Mastery of Regex and log parsing strategies for standard formats (Syslog, CEF, JSON).
  • Storage Architecture: Understanding of Data Lake principles (Parquet/Avro formats) vs. Data Warehouses.

Preferred / Nice to Have:

  • Experience with Vector Databases for storing embeddings.
  • Knowledge of Log Observability/Routing tools (middleware that routes logs).
  • Familiarity with Big Data frameworks (e.g., Spark, Flink).

 

 

Ability to embrace Clearwater's CLEAR core values (Commitment to Client Success, Lead with Accountability, Integrity & Collaboration, Excellence in All That We Do, Advance Colleague Success, Respect & Transparency) and culture.

Disclaimer: The above statements are intended to describe the general nature and level of work being performed by people assigned to this position. They are not to be construed as an exhaustive list of all responsibilities, duties, and skills required of colleagues in the role. All colleagues may be required to perform duties outside of their normal responsibilities from time to time, as needed. 

Clearwater is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. Please inform Clearwater/Redspin’s Recruiting team if you need any assistance completing any forms or to otherwise participating in the application process. 

Mental/Physical Requirements: Fast paced environment handling multiple demands. Must be able to exercise appropriate judgment as necessary. Requires a high level of initiative and independence. Excellent written and oral communication skills required. Requires the ability to use a personal computer for extended periods of time.

About this role

Clearwater Analytics is seeking a Senior Security Data Engineer to build and maintain the data infrastructure that powers their security operations. You'll own high-throughput streaming pipelines ingesting logs from firewalls, cloud platforms, and endpoints, then normalize that raw data into standard schemas (OCSF, ECS) for consistent analysis. The role balances technical depth with practical business sense—you'll implement routing logic that sends high-value security data to the SIEM while directing bulk logs to cost-effective object storage, and you'll prepare cleaned datasets to fuel AI/ML detection models and advanced analytics.

This position requires 5–10 years of data engineering experience and strong fundamentals in Python, SQL, and streaming technologies like Kafka or Pub/Sub. You'll need hands-on expertise in log parsing (Regex, Syslog, CEF, JSON formats) and a solid grasp of data architecture—knowing when to use Data Lakes (Parquet/Avro) versus Data Warehouses. Experience with vector databases, log routing middleware, or big data frameworks like Spark or Flink is a plus.

You'll report to Shivendra Ashish and work in-office in Pune. The role demands someone comfortable in a fast-paced environment who can juggle competing priorities, exercise independent judgment, and communicate clearly both in writing and conversation. If you're drawn to security data challenges and want to shape how organizations ingest and act on their logs at scale, this is worth your consideration.

This role's local market on JobMinglr

Pay for this role

The employer didn't post a pay range for this role. That usually means pay is set in negotiation, which favors whoever arrives with numbers. Check ranges on comparable Senior Software Engineer postings in Pune (M.H), and analyze any offer before you accept it.

How JobMinglr reads this job

Every listing here is scored against your profile before you apply: skills overlap, experience level, location and work arrangement, each weighted and explained. You see the score and the reasons, not just a list. How the matching works.