大语言模型实用指南(影印版)
大语言模型实用指南(影印版)
Jay Alammar, Maarten Grootendorst
出版时间:2025年02月
页数:403
“Jay和Maarten延续了两人的传统,为复杂的主题提供精美的插图和深刻的描述。对于任何想要了解大型语言模型主要构建技术的人而言,本书都是不容错过的宝贵资源。”
——Andrew Ng
DeepLearning.AI创始人
“我想不到还有哪本书能比眼前的这本更重要。本书字字珠玑,我在每一页上都能学到在这个语言模型时代取胜的关键。”
——Josh Starmer
StatQuest公司

在过去的几年,AI获得了令人惊讶的新语言能力。在深度学习快速发展的推动下,语言AI系统比以往任何时候都能更好地编写和理解文本。这一趋势正在催生新功能、新产品,甚至新的行业。通过本书的可视化教育方式,读者将学习到现在使用这些功能所需的实用工具和概念。
你将了解如何将预训练的大语言模型用于文案撰写和摘要生成等应用场景,创建超越关键字匹配的语义搜索系统,以及使用现有库和预训练的模型进行文本分类、搜索和聚类。
本书还将帮助你:
● 理解在文本生成和表征方面表现出色的Transformer语言模型的架构
● 构建高级LLM管道,对文本文档进行聚类并探索相关的主题
● 使用密集检索和重新排序等方法构建超越关键词搜索的语义搜索引擎
● 从提示工程到检索增强生成,探索如何使用生成式模型
● 通过生成式模型微调、对比式微调、上下文学习,深入学习如何为特定应用训练和优化LLM
  1. Preface
  2. Part I. Understanding Language Models
  3. 1. An Introduction to Large Language Models
  4. What Is Language AI?
  5. A Recent History of Language
  6. The Moving Definition of a “Large Language Model”
  7. The Training Paradigm of Large Language Models
  8. Large Language Model Applications: What Makes Them So Useful?
  9. Responsible LLM Development and Usage
  10. Limited Resources Are All You Need
  11. Interfacing with Large Language Models
  12. Generating Your First Text
  13. Summary
  14. 2. Tokens and Embeddings
  15. LLM Tokenization
  16. Token Embeddings
  17. Text Embeddings (for Sentences and Whole Documents)
  18. Word Embeddings Beyond LLMs
  19. Embeddings for Recommendation Systems
  20. Summary
  21. 3. Looking Inside Large Language Models
  22. An Overview of Transformer Models
  23. Recent Improvements to the Transformer Architecture
  24. Summary
  25. Part II. Using Pretrained Language Models
  26. 4. Text Classification
  27. The Sentiment of Movie Reviews
  28. Text Classification with Representation Models
  29. Model Selection
  30. Using a Task-Specific Model
  31. Classification Tasks That Leverage Embeddings
  32. Text Classification with Generative Models
  33. Summary
  34. 5. Text Clustering and Topic Modeling
  35. ArXiv’s Articles: Computation and Language
  36. A Common Pipeline for Text Clustering
  37. From Text Clustering to Topic Modeling
  38. Summary
  39. 6. Prompt Engineering
  40. Using Text Generation Models
  41. Intro to Prompt Engineering
  42. Advanced Prompt Engineering
  43. Reasoning with Generative Models
  44. Output Verification
  45. Summary
  46. 7. Advanced Text Generation Techniques and Tools
  47. Model I/O: Loading Quantized Models with LangChain
  48. Chains: Extending the Capabilities of LLMs
  49. Memory: Helping LLMs to Remember Conversations
  50. Agents: Creating a System of LLMs
  51. Summary
  52. 8. Semantic Search and Retrieval-Augmented Generation
  53. Overview of Semantic Search and RAG
  54. Semantic Search with Language Models
  55. Retrieval-Augmented Generation (RAG)
  56. Summary
  57. 9. Multimodal Large Language Models
  58. Transformers for Vision
  59. Multimodal Embedding Models
  60. Making Text Generation Models Multimodal
  61. Summary
  62. Part III. Training and Fine-Tuning Language Models
  63. 10. Creating Text Embedding Models
  64. Embedding Models
  65. What Is Contrastive Learning?
  66. SBERT
  67. Creating an Embedding Model
  68. Fine-Tuning an Embedding Model
  69. Unsupervised Learning
  70. Summary
  71. 11. Fine-Tuning Representation Models for Classification
  72. Supervised Classification
  73. Few-Shot Classification
  74. Continued Pretraining with Masked Language Modeling
  75. Named-Entity Recognition
  76. Summary
  77. 12. Fine-Tuning Generation Models
  78. The Three LLM Training Steps: Pretraining, Supervised Fine-Tuning, and Preference Tuning
  79. Supervised Fine-Tuning (SFT)
  80. Instruction Tuning with QLoRA
  81. Evaluating Generative Models
  82. Preference-Tuning / Alignment / RLHF
  83. Automating Preference Evaluation Using Reward Models
  84. Preference Tuning with DPO
  85. Summary
  86. Afterword
  87. Index
书名:大语言模型实用指南(影印版)
国内出版社:东南大学出版社
出版时间:2025年02月
页数:403
书号:978-7-5766-1766-5
原版书书名:Hands-On Large Language Models
原版书出版商:O'Reilly Media
Jay Alammar
 
Jay Alammar,Cohere总监兼工程研究员,知名大模型技术博客博主,DeepLearning.AI、Udacity热门课程作者。
 
 
Maarten Grootendorst
 
Maarten Grootendorst,IKNL(荷兰综合癌症中心)高级临床数据科学家,知名大模型技术博客博主,BERTopic等大模型软件包作者,DeepLearning.AI、Udacity热门课程作者。
 
 
The animal on the cover of Hands-On Large Language Models is a red kangaroo (Osphranter rufus). They are the largest of all kangaroos, with a body length that can get up to a little over 5 feet and a tail as long as 3 feet. They are very fast and can hop to speeds over 35 miles per hour. They can jump 6 feet high and leap a distance of 25 feet in a single bound. The position of their eyes allows them see up to 300 degrees.
Red kangaroos are named after the color of their fur. While the name makes sense for the males—they have short, red-brown fur—females are typically more of a blue-grey color with a tinge of brown throughout. The red color in their fur comes from a red oil excreted from the glands in their skin. Because of their color, Australians refer to male red kangaroos as “big reds.” However, because females are faster than males, they are often called “blue fliers.”
Preferring open, dry areas with some trees for shade, red kangaroos can be found across Australia’s mainland except in the upper north, lower southwest, and east coast regions of the country. Surrounding environmental conditions can affect reproduction. Because of this, females can pause or postpone pregnancy or birth until conditions are better. They often use this ability to delay birth of a new baby (joey) until the previous one has left their pouch.
购买选项
定价:186.00元
书号:978-7-5766-1766-5
出版社:东南大学出版社