Who We Are
Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.
To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.
What You'll Do
To realize our aspirations to build a Gen AI assistant that will transform the way BCG works, we are looking for LLM engineers who are passionate about designing, developing, and optimizing GenAI products. You will work within the LLM Squad and your Squad Leader in your domain of expertise, helping to advance the work and using your experience to maximize Squad performance. You will bring expertise in full stack development, Performance, and stability of custom-built products. This role is involved in all aspects of LLM based application including LLM expertise, Data science/ML, backend development including API and core functional logic. Work would also involve documentation of all designs and development.
Among your responsibilities, you will:
Continuously developing your expertise:
Keeping your technical skills and knowledge sharp, ensuring you remain up-to-date with the latest industry trends and innovations, both internally and externally.
Staying well-versed in the tools, methods, and technologies that best serve your team’s needs.
Sharing knowledge and expertise:
Actively contributing to knowledge-sharing within your team and across related teams, ensuring alignment with technical roadmaps and guidelines.
Bringing insights from your domain expertise to discussions, helping to guide technical direction and bestpractices.
Contributing to the Squad’s success:
Working with your Squad to achieve its mission by advancing tasks based on the priorities set by the product owner.
Collaborating cross-functionally, leveraging your expertise to support the Squad’s goals and deliver impactful results.
Identifying and supporting resource needs:
Identifying where technical expertise is needed and suggesting ways to fill any gaps, whether through yourown contributions, training, or advocating for new resources.
Adapting to the organization’s new ways of working:
Actively embracing and supporting the organization’s new working models, including Agile practices.
Contributing to a positive and collaborative team culture by embodying the values of the new way of working
What You'll Bring
BA degree in Computer Science, Statistics, or related field with a focus on Artificial Intelligence,Machine Learning, or Natural Language Processing
2+ years of experience developing and experimenting with LLMs
3+years of experience developing AI/ML technologies within large and business critical applications
Experience & Skills (Mandatory)
Proficiency in Python and all associated DS libraries and frameworks
Strong knowledge in AI, machine learning, and natural language processing
Experience with leveraging, training and fine-tuning Foundation Models, including multimodal inputs and outputs
Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)
Experience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios.
Experience with unstructured.io or similar libraries for handling various document formats…