Any tips or ideas on choosing a final year project? I don’t really have any ideas in mind other than implementing an LLM, not sure how applicable or good this is though, my major is computer engineering and i’m only interested in software dev

  • sevenapples@lemmygrad.ml
    link
    fedilink
    arrow-up
    3
    ·
    6 months ago

    The math involved in LLMs is not complex for anyone that has passed undergrad Calc and Linear Algebra classes. If you know derivatives, the chain rule and some matrix basics you can figure them out with enough studying.

    The hard part about LLMs is not the math but the neural net architecture innovations they brought (eg self-attention)