Skip to content
AK
Back to all projects

LLM and Agentic AI

Client project

Multilingual Learning Assistant

Problem

Lecture recordings are hard to study from when learners do not share the language of the recording.

System

A multilingual learning workflow that extracts audio from lecture videos, transcribes it with speech recognition, translates and indexes the transcript, and then answers learner questions and generates quizzes from the indexed content. Built during my TLS work on learning-content automation.

My contribution

Built the transcript and translation pipeline, implemented the retrieval and question-answering workflow, and automated quiz generation from processed lecture content.

System architecture

  1. Lecture video
  2. Audio extraction
  3. Speech recognition
  4. Transcript processing
  5. Translation and indexing
  6. Q&A and quiz generation

Technical focus

  • Speech recognition
  • Translation and multilingual NLP
  • Retrieval and question answering
  • Quiz generation
  • Workflow automation

Technology stack

  • Python
  • Transformer models
  • LangChain
  • FastAPI

Data source

Dataset and data-collection write-up is being prepared.

Data pipeline

Ingestion and preprocessing write-up is being prepared.

Model or LLM workflow

Model and workflow write-up is being prepared.

Evaluation and results

Evaluation setup and results write-up is being prepared.

Challenges and engineering decisions

Key engineering decisions write-up is being prepared.