llmdeepdive

Type to search

    Learning track

    From Text to Tensors

    See how text becomes tokens, vectors, and numerical structures a neural network can process.

    foundations · 7 available lessons

    From Text to Tensors

    See how text becomes tokens, vectors, and numerical structures a neural network can process.

    1. Why computers can't read
    2. Tokenization I: characters, words, and subwords
    3. Tokenization II: BPE, step by step
    4. Tokenization III: SentencePiece, byte-level, and why token counts bite
    5. Embeddings: meaning as geometry
    6. word2vec, GloVe, and the analogy trick
    7. Entropy, perplexity, and what 'good' means