Systems Software Engineer (Rust, ML Inference) | JobSetuu

Description

Job Overview

• Source: Arbeitnow
• Location: Berlin
• Job Type: Full-Time

Job Description

ai-coustics is building the reliability layer for Voice AI, the system that closes the gap between raw audio input and reliable machine understanding in production. By combining state-of-the-art speech and audio research with real-time, production-grade SDKs, we test, observe, and enable Voice AI systems to work in any environment. Our software is used by fast-growing Voice AI companies across Europe and the United States whose products require reliable performance at scale: call center agents, voice agents, telephony apps, and enterprise voice assistants. We believe voice will become the main interface for technology and ai-coustics is building the foundational infrastructure to make audio input reliable, measurable, and easy to deploy.

We are backed by leading early-stage investors including Connect Ventures, Partech, Inovia Capital, as well as angel investors from HuggingFace, DeepMind and Amazon with deep expertise in AI and developer infrastructure. These partners share our vision and are helping us build a world-class team operating with high levels of responsibility and velocity. We look for people who take ownership, think systemically, and want to solve challenging real-world problems in close collaboration with our customers. If you're motivated by developing technology that is used in practice, shaping an emerging category and setting a new standard for how voice AI works in the real world, you'll feel at home at ai-coustics.

Role Overview

ai-coustics is seeking a Systems Software Engineer to join our Systems team, working at the core of our real-time Audio AI SDK and inference infrastructure. In this role, you will help maintain, optimize, and expand the SDK that powers ai-coustics' speech enhancement and Voice AI products across a wide range of platforms, runtimes, and languages.

You will work primarily on our Rust-based inference and systems codebase, which underpins the Airten real-time inference engine, DSP modules, telemetry, model execution pipeline, and public SDKs used by developers worldwide. Your work will directly impact model performance, runtime efficiency, reliability, developer experience, and our ability to deploy neural audio models in latency-critical production environments.

This role sits at the intersection of systems programming, ML inference, real-time audio, and developer infrastructure. You do not need to be an ML researcher, but you should be excited about making neural networks run fast, safely, and predictably in real-world applications.

Ideal starting date: August/September

Tasks

ML Inference Engine & Runtime Development

• Design, implement, and optimize systems-level components of the ai-coustics SDK and inference runtime
• Improve the performance, memory usage, and stability of the Airten real-time inference engine
• Work on model execution, tensor operations, scheduling, streaming inference, and runtime abstractions
• Support deployment of neural audio models across CPU, WASM, and other constrained runtime environments
• Explore and integrate ideas from modern inference engines and ML runtimes such as Burn, ONNX Runtime, tract, TensorRT, or similar systems
• Help bridge the gap between research models and production-ready, low-latency inference

Audio, DSP & Real-Time ML Systems

• Develop and maintain DSP modules and supporting audio-processing infrastructure
• Optimize streaming workloads under strict latency, jitter, and memory constraints
• Build tooling to validate numerical correctness, real-time behavior, and model quality across platforms
• Collaborate with ML researchers to make models easier to export, test, benchmark, and deploy
• Contribute to model conversion and deployment workflows, including formats such as ONNX, internal model formats, or Rust-native representations

Language Bindings & Platform Support

• Maintain and expand our C API and public C library generated from our internal Rust codebase
• Improve and support SDK wrappers and bindings for C++, Python, and Rust via the public C API
• Maintain WASM and Node.js SDKs built directly from the internal Rust source
• Ensure consistent behavior, performance, and API guarantees across Linux, macOS, Windows, WASM, and embedded-adjacent environments

Testing, Reliability & Tooling

• Design, implement, and extend our testing pipeline, including unit tests, integration tests, numerical tests, and performance benchmarks
• Build tooling to validate real-time constraints, memory usage, model outputs, and cross-language consistency
• Improve CI workflows to ensure safe and fast iteration on a closed-source core with public-facing SDKs
• Create benchmarks and profiling workflows that help us understand runtime bottlenecks and performance regressions
• Improve observability and diagnostics for SDK integrations in customer environments

Documentation & Developer Experience

• Write and maintain technical documentation for SDK APIs, runtime internals, model deployment, and integration guides
• Collaborate with product and developer-facing teams to improve onboarding and usability
• Support internal teams and external developers by diagnosing SDK and inference issues and proposing robust fixes
• Contribute to API design with a focus on ergonomics, safety, portability, and long-term maintainability

Requirements

Technical Skills

• Strong experience in systems programming, ideally with Rust
• Solid understanding of C/C++ interoperability, ABIs, and FFI design
• Experience building or maintaining SDKs, libraries, inference runtimes, or developer-facing systems
• Familiarity with real-time systems, performance optimization, memory management, and profiling
• Experience writing tests and benchmarks for low-level or performance-critical code
• Comfortable working across multiple platforms such as Linux, macOS, Windows, and WASM
• Ability to reason about API design, unsafe boundaries, ownership, error handling, and long-term maintainability

ML Inference & Audio Systems

• Familiarity with ML inference runtimes or deploying neural networks in production
• Experience with model formats or inference engines such as ONNX, Burn, tract, TensorRT, TFLite, Core ML, or similar systems
• Understanding of how neural networks are represented, executed, optimized, and benchmarked
• Exposure to real-time audio constraints such as latency, jitter, buffering, streaming workloads, and deterministic processing
• Interest in making ML models portable, efficient, and reliable outside of Python research environments

Mindset & Collaboration

• Strong ownership mentality and attention to detail
• Comfortable working in a closed-source core with open SDK surfaces
• Ability to reason about trade-offs between performance, safety, portability, and developer experience
• Clear written communication skills for documentation and technical design discussions
• Enjoys working in a fast-moving startup environment with real-world production impact
• Excited about building infrastructure that helps Voice AI systems work reliably in messy, real-world audio conditions

Benefits

• Opportunity to work at a rapidly growing Voice AI startup, backed by top investors.
• Compensation and equity: Competitive salary package, additional benefits and stock options, enabling you to take part in the company’s success.
• Startup Culture: Dynamic, fast-paced environment with passionate and collaborative colleagues.
• High Impact: Groundbreaking startup at a pivotal growth stage, making a real difference in how people experience audio.
• Ownership & Autonomy: Take full ownership of projects and ship fast.
• Work With the Best: World-class team of engineers and builders with ample room for professional growth.
• Contribute to the Future: Define the landscape of Voice AI technology.

If you are ready to lead the charge in revolutionizing Voice AI and drive our startup to new heights, we would love to hear from you. Apply today to join the ai-coustics team!

Find more English Speaking Jobs in Germany on Arbeitnow

Expert Career Tips for Systems Software Engineer (Rust, ML Inference) Roles

To succeed in a competitive market as a Systems Software Engineer (Rust, ML Inference), you need more than just technical skills. Here are some expert strategies to elevate your profile:

• Build a Strong Portfolio: For technical roles, a clean GitHub or a personal project site is essential. For non-technical roles, a case study portfolio demonstrating problem-solving and impact is equally valuable. Show, don't just tell, what you have achieved in your previous positions.
• Master the Narrative: When interviewing, use the STAR method (Situation, Task, Action, Result) to structure your answers. Quantify your results wherever possible—mentioning "increased efficiency by 20%" is much more impactful than saying "improved efficiency."
• Continuous Learning: The industry moves fast. Whether it's staying updated with the latest AI tools or mastering a new management methodology, continuous professional development is key. Consider obtaining industry-recognized certifications that align with Systems Software Engineer (Rust, ML Inference) requirements.
• Networking: Connect with other professionals in similar roles. Join online communities, attend webinars, and engage in meaningful discussions on professional social networks. Often, the best opportunities come through referrals and community engagement.
• Soft Skills Matter: Communication, empathy, and leadership are often the deciding factors between two equally qualified technical candidates. Cultivate these skills as they are universally valued across all industries and seniority levels.

Additionally, research the specific company's culture and values. Tailoring your application to show how you align with their mission can significantly increase your chances of moving forward in the process.

Salary & Compensation

Salary not disclosed; typically competitive for the role.

Work Arrangement

Type: On-Site

Standard business hours at the office.

Comprehensive Application Strategy & Hiring Process

Applying for a new role is a marathon, not a sprint. Follow this strategic approach to maximize your success rate:

1. Initial Research & Tailoring

Don't send the same resume to every employer. Spend at least 30 minutes researching the company. Look for recent news, their product roadmap, and their team structure. Modify your summary and core competencies to reflect the specific keywords found in the job description.

2. The Perfect Cover Letter

If the application allows for a cover letter, use it to tell a story that your resume cannot. Explain why you are passionate about this specific company and how your unique background makes you the perfect fit for the challenges they are currently facing.

3. Navigating the Multi-Stage Interview

Most modern hiring processes involve 3-5 stages. This typically includes a recruiter screen, a technical or skill-based assessment, a peer interview, and a final leadership round. Prepare for each stage differently: focus on enthusiasm and fit for the recruiter, technical depth for the assessment, and strategic vision for the leadership round.

4. Post-Interview Follow-Up

Always send a personalized thank-you note within 24 hours of each interview. Reference a specific topic discussed during the call to demonstrate your active listening and genuine interest in the role.

By following these steps, you demonstrate a high level of professionalism and attention to detail that sets you apart from the average applicant.

Typical Interview Process

1. Resume screening
2. HR call
3. Skill interview
4. Final manager interview
5. Offer

Tip: Research the company's products and culture.

Global Market Intelligence & Relocation Insights

At JobSetuu, we specialize in helping talent navigate the global job market. Here is what you need to know about the current landscape in Berlin and beyond:

The demand for skilled professionals is increasingly borderless. For roles based in Berlin, understanding the local cost of living, visa requirements (if applicable), and cultural nuances is vital. If this is a remote role, consider the time zone alignment and the asynchronous communication culture of the hiring organization.

Relocation Support: Many forward-thinking companies offer relocation packages that include moving stipends, temporary housing, and legal assistance with work permits. When evaluating an offer, look beyond the base salary—consider the total compensation package, including equity, bonuses, and healthcare benefits.

Work-Life Balance Trends: Hybrid and remote work have become standard in many regions. Research the local labor laws and common practices regarding work hours and vacation time to ensure the role aligns with your lifestyle goals.

Leveraging JobSetuu's tools can help you compare salaries across different cities and understand the "purchasing power" of your potential offer, ensuring you make an informed decision for your long-term career path.

Skills & Competency Roadmap for Professional Development

To remain competitive in Professional Development, we recommend focusing on the following core competencies over the next 12-18 months:

• Technical Mastery: Deepen your expertise in the core tools and languages relevant to your field. For developers, this might be cloud architecture; for marketers, it might be data-driven attribution modeling.
• AI Augmentation: Learn how to leverage generative AI and automation tools to increase your productivity. Understanding how to integrate these technologies into your workflow is becoming a non-negotiable skill.
• Leadership & Strategy: Even in individual contributor roles, the ability to think strategically and lead projects from inception to completion is highly valued. Focus on stakeholder management and high-level project planning.
• Data Literacy: The ability to interpret data and use it to drive decisions is essential across all business functions. Familiarize yourself with data visualization and basic analytical concepts.

By investing in these areas, you not only prepare yourself for the role you are applying for today but also build a resilient foundation for the opportunities of tomorrow.

Apply via JobSetuu

Discover your next career milestone on JobSetuu. This Systems Software Engineer (Rust, ML Inference) position is part of our commitment to bringing you the most relevant and high-impact job openings globally. At JobSetuu, we simplify your job search by aggregating premier listings and providing the tools you need to stand out. Don't miss the chance to elevate your professional journey—explore more opportunities and career insights on our platform today.