Research Intern - AI Frontiers - Agentic AI Models & Synthetic Data Generation

Job Description

Research Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment. The AI Frontier Lab at Microsoft Research is seeking Research Interns to advance the state of the art in foundational model post-training, specialization and aligning models to Agentic AI capabilities such as reasoning and computer use. Our work spans both synthetic data generation and algorithmic advances in model training recipes. Our lab conducts cutting-edge research in artificial intelligenace (AI) and publishes findings in top-tier venues in AI and machine learning (ML), including NeurIPS, ICLR, ICML, and others. We release models and libraries focusing on small models (e.g. Phi-3 , Orca ), synthetic data generation (e.g. AgentInstruct ), and Agentic AI (e.g. OmniParser , AutoGen ). The lab also works within Microsoft's ecosystem to impact our AI-driven technologies in multiple products. We seek Research Interns with demonstrated ability for technical work and a proven record of influential publications on AI. For this role you should have a keen interest in developing synthetic data generation methods or training algorithms that enable models to take actions in a virtual world and reason more effectively, while maintaining computational efficiency. Research areas of particular interest for this team include, but are not limited to: Our group takes a holistic approach to improving foundational models that includes a variety of data modalities (language, vision, multi-modal, and structured data) and modern model architectures. Priority will be given to candidates with a proven publication record in top-tier conferences, who have demonstrated the ability to develop original research and perform hands-on research, and who work well in a collaborative and dynamic environment.

Requirements

• Accepted or currently enrolled in a PhD program in Computer Science or related STEM field.
• Research Interns are expected to be physically located in their manager’s Microsoft worksite location for the duration of their internship.
• In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position as well as a cover letter and any relevant work or research samples. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.
• Experience publishing academic papers as a lead author or essential contributor.
• Experience participating in a top conference in relevant research domain.
• Demonstrated ability to develop original research agendas.
• Ability to work in a collaborative environment with multi-disciplinary teams. Active participation in the scientific community.
• Well-established research record of publications in top-tier journals/conferences.
• Hands-on experience with popular machine learning frameworks (e.g. pytorch, tensorflow, scikit-learn) and cloud platforms.
• Experience with training and evaluating machine learning models for Natural Language Processing, Vision, and Multimodal tasks.
• Experience with one data type is sufficient but candidates should be open to collaborating in projects that study a variety or a combination of modalities.

Responsibilities

• Research Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world’s best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer.
• Developing methods to create high-quality data synthetically, with minimal human intervention.
• Agentic systems for data generation, selection and filtering.
• Developing novel training algorithms for enhancing reasoningand /or action taking.
• Reinforcement learning approaches for improving logical and mathematical reasoning.
• Exploring scaling laws between test-time and training-time compute.
• Advanced optimization techniques for efficient training of large-scale models.
• Execute research directions that are at the forefront of innovation in AI.
• Create synergies on joint, high-impact projects in collaboration with other researchers, engineers, and product group partners.
• Work closely with other researchers in the teams on a research problem.

Benefits

• Industry leading healthcare
• Educational resources
• Discounts on products and services
• Savings and investments
• Maternity and paternity leave
• Generous time away
• Giving programs
• Opportunities to network and connect