Senior AI Researcher- Pre-training (f/m/d)
AI Quick Take & Executive Summary: Senior AI Researcher- Pre-training (f/m/d) is an active, verified Full Time opportunity offered by Alephalpha in Heidelberg, Germany with On Site workplace arrangement. The officially disclosed compensation is Competitive / Negotiable. Eligibility is established for 2+ Years with professional qualifications in IT & Software Engineering. Direct 1-click application is available online with zero candidate recruitment fees.
📋 Verified Role Overview & Factual Specifications
- Job Role ID
- #VHR-831142
- Hiring Employer
- Alephalpha ✓
- Disclosed Compensation
- Competitive / Negotiable
- Workplace Mode
- On Site
- Work Location
- Heidelberg, Germany
- Employment Type
- Full Time
- Experience Required
- 2+ Years
- Industry Sector
- IT & Software Engineering
- Employer Accreditation
- ✓ 100% Verified Employer
- Application Route
- ⚡ Apply on Company Website ↗
✈️ Overseas Sponsorship & Expatriate Benefits
Job Overview & Description
Aleph Alpha is one of the few companies in Europe doing serious foundation model pre-training like our recently released Kolibri-1 model. Our customers - in finance, manufacturing, public administration - need models that understand German, meet European regulatory requirements, and work reliably in high-stakes settings. We're building that in Heidelberg.
We are hiring a Senior AI Researcher to join our Pre-training team and to advance the architecture and training of our next generation of foundation models. If you are excited about designing inference-efficient architectures, optimizing training recipes that scale reliably, and training models on a large scale cluster (thousands of NVIDIA Blackwell GPUs), we would love to hear from you.
We foster a culture built on ownership, autonomy, and empowerment. Teams and individual contributors are trusted to take responsibility for their work and drive meaningful impact. We maintain a flat organisational structure with efficient, supportive management that enables quick decision-making, open communication, and a strong sense of shared purpose. We collaborate closely on complex technical problems, working in pairs or using mob programming to resolve challenging issues.
About the RoleAs a Senior AI Researcher in Pre-training (f/m/d), you will own the critical technical levers that determine the success of our next-generation models: architecture, optimization, stability, and scaling.
Working at the high-leverage intersection of research and engineering, you will translate mathematical reasoning and empirical observations into principled training decisions - from small-scale proxy experiments to multi-thousand-GPU runs.
We are looking for an expert who can combine rigorous experimental design with high-quality production code, directly influencing model quality, run reliability, and the efficiency of the models we ship.
Your ResponsibilitiesRecipe & Architecture Optimization: Own core elements of the training recipe (optimizers, schedules, initialization) and design PyTorch-based architectural improvements to maximize convergence, stability, and training efficiency.
Scaling Strategy & Predictability: Develop hyperparameter scaling laws and scale-up methodologies, using small-scale proxy experiments to reliably predict multi-thousand-GPU behavior and de-risk major training decisions.
Stability, Diagnostics & Debugging: Investigate complex convergence issues (loss spikes, divergence) and resolve hard-to-reproduce distributed system failures like communication bottlenecks, race conditions, and synchronization errors.
System-Model Co-Design: Partner with Compute Performance, Data, Evaluation, and Post-Training teams to align the model lifecycle with hardware constraints, memory bandwidth, and communication topologies.
You are proficient in Python and deeply familiar with PyTorch-based training workflows.
You have a strong track record in machine learning research and software engineering, demonstrated through shipped models, impactful open-source contributions, or published research.
You have a strong mathematical foundation and are comfortable reasoning formally about optimisation, scaling behaviour, and training dynamics.
You deeply understand transformer training dynamics, optimisation, and the behaviour of large distributed training jobs.
You can design rigorous experiments, reason clearly from noisy results, and translate empirical observations into robust training decisions.
Hands-on experience pre-training large models (e.g., 7B+ parameters) on substantial infrastructure (e.g., 100+ GPU clusters).
You apply strong software engineering practices, including writing maintainable, well-tested code and supporting reproducible experimentation workflows.
You are able to implement complex model architectures efficiently and reliably and to debug complex issues across model code, training dynamics, and distributed systems.
You collaborate effectively within a research and engineering team and communicate clearly about your work across Pre-training and the broader AAR/AA organization.
You are able to work in Germany and collaborate regularly on site in Heidelberg as part of the Pre-training team.
Preferred Qualifications
Large-Scale Training: Hands-on experience training LLMs or multimodal models on large GPU clusters using distributed frameworks (e.g., Megatron-LM, DeepSpeed, torchtitan).
Predictive Scaling: Familiarity with scaling laws, hyperparameter transfer, or methods for predicting large-scale training behavior from smaller proxy runs.
Stability & Performance: Experience profiling distributed jobs and diagnosing training anomalies like loss spikes, numerical instability, or optimizer pathologies.
Advanced Architectures: Exposure to sparse training approaches (e.g., Mixture-of-Experts) and an understanding of their routing and systems trade-offs.
Track Record of Impact: Demonstrated research excellence through top-tier publications (NeurIPS, ICML, ICLR), impactful open-source contributions, or significant shipped technical work.
Systems Curiosity: Low-level kernel optimization is not required, but we highly value a strong curiosity about the hardware and systems constraints that shape scale.
What we offer
Become part of an AI revolution!
30 days of paid vacation
Access to a variety of fitness & wellness offerings via Wellhub
Mental health support through nilo.health
Substantially subsidized company pension plan for your future security
Subsidized Germany-wide transportation ticket
Budget for additional technical equipment
Flexible working hours for better work-life balance and hybrid working model
JobRad® Bike Lease
Find more English Speaking Jobs in Germany on Arbeitnow
Job Posted on:
VISA HR GLOBAL
Estimated In-Hand Salary Breakdown
For this role's disclosed compensation (Competitive / Negotiable), estimated net monthly cash in-hand is Competitive / Negotiable after statutory Employee Provident Fund (12% EPF) and standard deduction under India's New Tax Regime.
Explore Matching Compensation Roles →Recruiter Guidance & Selection Process for Senior AI Researcher- Pre-training (f/m/d)
Highlight hands-on experience in IT & Software Engineering. Focus on measurable deliverables, overseas readiness, and problem-solving examples.
Structure interview answers using the STAR Method (Situation, Task, Action, Result). Quantify achievements with percentages and business impact.
Keep valid Passport, National ID (Aadhaar/PAN), highest degree marksheets, previous relieving letter, and last 3 months salary slips ready for international verification.
Apply for Senior AI Researcher- Pre-training (f/m/d)
Submit your verified profile and credentials directly to Alephalpha with full international visa and relocation guidance.
About Alephalpha
Alephalpha is an active employer on VISA HR GLOBAL, operating in Heidelberg, Germany across IT & Software Engineering and international sectors.
💬 Frequently Asked Questions
Q What is the starting salary and compensation for Senior AI Researcher- Pre-training (f/m/d) at Alephalpha? ▼
The officially disclosed compensation for Senior AI Researcher- Pre-training (f/m/d) at Alephalpha is Competitive / Negotiable. Net estimated take-home is approx. Competitive / Negotiable depending on statutory tax and pension contributions.
Q Is this Senior AI Researcher- Pre-training (f/m/d) position remote, hybrid, or on-site? ▼
This is a On Site role located in Heidelberg, Germany.
Q What are the eligibility criteria and can freshers apply for Senior AI Researcher- Pre-training (f/m/d)? ▼
This position requires approximately 2+ Years of relevant industry experience in IT & Software Engineering. Relevant educational degree or certifications are required.
Q What are the key qualifications and skills required for this job? ▼
Key competencies for Senior AI Researcher- Pre-training (f/m/d) include domain expertise in IT & Software Engineering, collaboration, problem-solving, and professional communication skills.
Q How do I apply for Senior AI Researcher- Pre-training (f/m/d) at Alephalpha? ▼
You can apply directly online through VISA HR GLOBAL with 1-click apply. Submit your credentials for instant recruiter review or follow the direct link to the company's official career portal. No candidate fees or charges.
Q Is Alephalpha a verified employer on VISA HR GLOBAL? ▼
Yes, Alephalpha is an administratively verified employer with official overseas recruitment credentials and valid job postings on VISA HR GLOBAL.