{"id":897,"date":"2026-07-03T16:40:22","date_gmt":"2026-07-03T16:40:22","guid":{"rendered":"https:\/\/hyc.eshachem.com\/program\/?page_id=897"},"modified":"2026-07-04T02:37:06","modified_gmt":"2026-07-04T02:37:06","slug":"2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85","status":"publish","type":"page","link":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/","title":{"rendered":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><code>input_seq = input_seq[1:] + [next_char_id]<\/code><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>AI \u8b80\u4e86 <strong>3 \u500b\u5b57<\/strong> =&gt; \u99ac\u4e0a\u5410\u51fa <strong>1 \u500b\u5b57<\/strong>\u3002<\/li>\n\n\n\n<li>\u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 <strong>3 \u500b\u5b57<\/strong> =&gt; \u518d\u5410\u51fa <strong>1 \u500b\u5b57<\/strong>\u3002<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c<strong>\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684<\/strong>!<br>\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?<br>\u5047\u8a2d\u7ffb\u8b6f\uff1a<code><strong>\"What is your name?\"<\/strong><\/code>\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a<code>\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d<\/code>\uff085 \u500b\u5b57\uff09<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AI \u8b80\u5165 <code>\"What\"<\/code>  RNN \u88ab\u903c\u8457<strong>\u7576\u5834<\/strong>\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a<code>\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d<\/code>\uff08<s>\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916<\/s>\uff09\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">*\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bc<strong>Recurrent Neural Networks (RNNs): A gentle Introduction and Overview<\/strong>\u9019\u7bc7\u8ad6\u6587<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h1 class=\"wp-block-heading\" id=\"seq2seq\">Seq2Seq<\/h1>\n\n\n\n<p class=\"wp-block-paragraph\">\u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u300d\u9019\u7a2e\u300c\u8f38\u5165\u8207\u8f38\u51fa\u9577\u5ea6\u4e0d\u5c0d\u7b49\u3001\u8a9e\u5e8f\u4e0d\u540c\u300d\u7684\u96e3\u984c\uff0cGoogle \u7684\u5718\u968a\u5728 2014 \u5e74\u63d0\u51fa\u4e86\u4e00\u500b\u9769\u547d\u6027\u7684\u6846\u67b6\u2014\u2014<strong>Seq2Seq<\/strong>\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Seq2Seq \u7684\u6838\u5fc3\u601d\u60f3\u975e\u5e38\u512a\u96c5\uff0c\u5b83\u628a\u795e\u7d93\u7db2\u8def\u62c6\u6210\u4e86\u5169\u500b\u90e8\u5206\uff1a<strong>\u7de8\u78bc\u5668\uff08Encoder\uff09<\/strong> \u8207 <strong>\u89e3\u78bc\u5668\uff08Decoder\uff09<\/strong>\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"604\" height=\"120\" src=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/F378C281-9745-4D46-90C5-FF2807A3C46B.png\" alt=\"\" class=\"wp-image-902\" srcset=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/F378C281-9745-4D46-90C5-FF2807A3C46B.png 604w, https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/F378C281-9745-4D46-90C5-FF2807A3C46B-300x60.png 300w\" sizes=\"auto, (max-width: 604px) 100vw, 604px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>1. \u7de8\u78bc\u5668\uff08Encoder\uff09\uff1a\u8ca0\u8cac\u300c\u807d\u61c2\u4e26\u6253\u5305\u300d<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u6703\u8ca0\u8cac\u628a\u8f38\u5165\u7684\u6574\u53e5\u82f1\u6587\uff08\u6e90\u8a9e\u8a00\uff09\u4e00\u5b57\u4e0d\u6f0f\u5730\u8b80\u5b8c\uff0c\u5c31\u50cf\u500b\u60c5\u5831\u54e1\uff0c\u8b80\u5230 <code>\"I\"<\/code>\u3001<code>\"love\"<\/code>\u3001<code>\"learning\"<\/code>\u2026\u3002\u6bcf\u8b80\u4e00\u500b\u5b57\uff0c\u5b83\u5c31\u628a\u8cc7\u8a0a\u58d3\u7e2e\u9032\u96b1\u85cf\u72c0\u614b\uff08Hidden State\uff09\u88e1\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u7576\u6574\u53e5\u82f1\u6587\u8b80\u5b8c\u3001\u9047\u5230\u53e5\u5c3e\u7b26\u865f\u6642\uff0cEncoder \u6703\u628a\u524d\u9762\u6240\u6709\u5438\u6536\u5230\u7684\u7cbe\u83ef\uff0c\u58d3\u7e2e\u63d0\u7149\u6210\u4e00\u500b\u6700\u7d42\u7684\u56fa\u5b9a\u5927\u5c0f\u5411\u91cf\uff0c\u53eb\u505a <strong>Context Vector\uff08\u4e5f\u6709\u4eba\u53eb\u5b83 Thought Vector\uff0c\u601d\u60f3\u5411\u91cf\uff09<\/strong>\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u50cf\u662f\u53e3\u8b6f\u5b98\u7684\u7b46\u8a18!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>2. \u89e3\u78bc\u5668\uff08Decoder\uff09\uff1a<\/strong>\u8ca0\u8cac\u300c\u770b\u5716\u8aaa\u6545\u4e8b\u300d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u8ca0\u8cac\u628a\u90a3\u5f35\u5bc6\u78bc\u5c0f\u7d19\u689d\uff08Context Vector\uff09\uff0c\u7ffb\u8b6f\u6210\u76ee\u6a19\u8a9e\u8a00\uff08\u4e2d\u6587\uff09\u3002<br>\u4e00\u958b\u59cb\uff0cDecoder \u7684\u8166\u888b\u662f\u7a7a\u7684\uff0c\u4f46\u5b83\u62ff\u5230\u4e86 Encoder \u905e\u904e\u4f86\u7684\u90a3\u5f35<strong>\u5bc6\u78bc\u5c0f\u7d19\u689d<\/strong>\u4f5c\u70ba\u5b83\u7684\u521d\u59cb\u96b1\u85cf\u72c0\u614b\uff08\u521d\u59cb\u8a18\u61b6\uff09\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u63a5\u8457\uff0c\u5de5\u7a0b\u5e2b\u6703\u9935\u7d66\u5b83\u4e00\u500b\u958b\u982d\u8a0a\u865f<strong> <code>&lt;SOS&gt;<\/code><\/strong>\uff08Start of Sentence\uff0c\u958b\u59cb\u7b26\u865f\uff09\u3002Decoder \u770b\u8457\u5c0f\u7d19\u689d\uff0c\u5927\u8166\u77e9\u9663\u4e00\u7b97\uff0c\u5410\u51fa\u7b2c\u4e00\u500b\u5b57\uff1a<code>\"\u6211\"<\/code>\u3002\u63a5\u8457\u5b83\u6703\u628a\u81ea\u5df1\u525b\u525b\u5410\u51fa\u7684 <code>\"\u6211\"<\/code>\uff0c\u7576\u4f5c\u4e0b\u4e00\u500b\u6642\u9593\u9ede\u7684\u8f38\u5165\uff0c\u7d50\u5408\u624b\u4e2d\u7684\u5c0f\u7d19\u689d\uff0c\u7e7c\u7e8c\u5f80\u4e0b\u731c\uff1a<code>\"\u559c\u6b61\"<\/code> \u2192 <code>\"\u5b78\u7fd2\"<\/code>\u2026 \u4e00\u76f4\u731c\u5230\u5b83\u81ea\u5df1\u5410\u51fa <code><strong>&lt;EOS&gt;<\/strong><\/code>\uff08End of Sentence\uff0c\u7d50\u675f\u7b26\u865f\uff09\u624d\u6536\u5de5\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"642\" height=\"335\" src=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/578138B2-3644-40EF-B63D-ABBF0C7C1370.png\" alt=\"\" class=\"wp-image-903\" srcset=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/578138B2-3644-40EF-B63D-ABBF0C7C1370.png 642w, https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/578138B2-3644-40EF-B63D-ABBF0C7C1370-300x157.png 300w\" sizes=\"auto, (max-width: 642px) 100vw, 642px\" \/><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<p class=\"wp-block-paragraph\">\u7528\u525b\u525b\u7684<code><strong>\"What is your name?\"<\/strong><\/code>\u6f14\u793a\u4e00\u6b21:<\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Encoder \u555f\u52d5\uff1a<\/strong>\n<ul class=\"wp-block-list\">\n<li>t<sub>1<\/sub>: \u8b80\u5165 <code>\"What\"<\/code> \u2192 \u7a0d\u5fae\u8a18\u4f4f\u9019\u662f\u500b\u7591\u554f\u53e5\u3002<\/li>\n\n\n\n<li>t<sub>2<\/sub>: \u8b80\u5165 <code>\"is\"<\/code> \u2192 \u9806\u5411\u50b3\u905e\u3002<\/li>\n\n\n\n<li>t<sub>3<\/sub>, t<sub>4<\/sub>: \u8b80\u5165 <code>\"your\"<\/code>\u3001<code>\"name\"<\/code> \u2192 \u8b80\u5b8c\u53e5\u5c3e\u3002<\/li>\n\n\n\n<li><strong>\u7522\u751f Context Vector\uff1a<\/strong> \u77e9\u9663\u88e1\u585e\u6eff\u4e86\u300c\u5c0d\u65b9\u7684\u540d\u5b57\u3001\u7591\u554f\u53e5\u3001\u73fe\u5728\u5f0f\u300d\u7684\u62bd\u8c61\u8a9e\u7fa9\u3002Encoder \u529f\u6210\u8eab\u9000\uff0c\u4e1f\u7d66 Decoder\u3002<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Decoder \u555f\u52d5\uff1a<\/strong>\n<ul class=\"wp-block-list\">\n<li>\u96d6\u7136\u82f1\u6587\u958b\u982d\u662f <code>\"What\"<\/code>\uff08\u4ec0\u9ebc\uff09\uff0c\u4f46 Decoder \u878d\u6703\u8cab\u901a\u4e86\u6574\u500bcontext vector\u7684\u8a9e\u7fa9\u5f8c\uff0c\u5b83\u77e5\u9053\u4e2d\u6587\u7684\u7fd2\u6163\u8981\u5148\u63d0\u4e3b\u8a5e\uff0c\u65bc\u662f\u7b2c\u4e00\u500b\u5b57\u5410\u51fa\uff1a<code>\"\u4f60\"<\/code>\u3002<\/li>\n\n\n\n<li>\u63a5\u8457\u628a <code>\"\u4f60\"<\/code> \u4f5c\u70ba\u8f38\u5165\uff0c\u914d\u5408\u8a18\u61b6\uff0c\u4e0b\u4e00\u500b\u5b57\u5410\u51fa\uff1a<code>\"\u53eb\"<\/code> \u2192 <code>\"\u4ec0\u9ebc\"<\/code> \u2192 <code>\"\u540d\u5b57\"<\/code>\u3002<\/li>\n\n\n\n<li>\u76f4\u5230 <code>&lt;EOS&gt;<\/code>\uff0c\u5b8c\u7f8e\u901a\u95dc\uff01<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Seq2Seq \u7684\u51fa\u73fe\u76f4\u63a5\u62ef\u6551\u4e86\u7576\u5e74\u7684 Google \u7ffb\u8b6f\uff0c\u8b93\u6a5f\u5668\u7ffb\u8b6f\u8de8\u5165\u4e86\u4e00\u500b\u5168\u65b0\u7684\u6642\u4ee3\u3002\u4f46\u5f88\u5feb\u5730\uff0c\u5de5\u7a0b\u5e2b\u5728\u5be6\u52d9\u4e0a\u53c8\u649e\u4e0a\u4e86\u53e6\u4e00\u9762\u539a\u91cd\u7684\u7246 \u2013 \u300c\u8cc7\u8a0a\u74f6\u9838\uff08Information Bottleneck\uff09\u300d\uff1a<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u4e0d\u8ad6\u4f60\u8f38\u5165\u7684\u82f1\u6587\u53e5\u5b50\u6709\u591a\u9577\u2014\u2014\u662f 5 \u500b\u5b57\u7684\u77ed\u53e5\uff0c\u9084\u662f <strong>100 \u500b\u5b57\u9577\u7bc7\u5927\u8ad6<\/strong>\u3002Encoder \u6700\u7d42\u90fd<strong>\u5fc5\u9808\u3001\u5f37\u8feb\u3001\u53ea\u80fd<\/strong>\u628a\u6240\u6709\u7684\u8cc7\u8a0a\u58d3\u7e2e\u9032\u90a3\u500b\u300c\u56fa\u5b9a\u5927\u5c0f\u300d\u7684 <strong>Context Vector\uff08\u5c0f\u7d19\u689d\uff09<\/strong> \u88e1\u9762\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u7576\u53e5\u5b50\u9577\u9054 100 \u500b\u5b57\u6642\uff0c\u90a3\u5f35\u5c0f\u7d19\u689d\u6839\u672c\u585e\u4e0d\u4e0b\u9019\u9ebc\u591a\u7cbe\u83ef\u3002Encoder \u9867\u5f97\u4e86\u958b\u982d\u5c31\u9867\u4e0d\u4e86\u7d50\u5c3e\uff0c\u5c0e\u81f4\u5f8c\u9762\u7684\u9577\u53e5\u5b50\uff0cDecoder \u62ff\u5230\u7684\u7d19\u689d\u8cc7\u8a0a\u65e9\u5c31\u6a21\u7cca\u4e0d\u6e05\u4e86\u3002\u9019\u8b93 AI \u9762\u5c0d\u9577\u6587\u672c\u6642\uff0c\u7ffb\u8b6f\u54c1\u8cea\u76f4\u63a5\u96ea\u5d29\u5f0f\u66b4\u8dcc\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h1 class=\"wp-block-heading\" id=\"attention-mechanism\">Attention Mechanism<\/h1>\n\n\n\n<p class=\"wp-block-paragraph\">\u70ba\u4e86\u6253\u7834\u9019\u500b\u300e\u5c0f\u7d19\u689d\u300f\u7684\u8cc7\u8a0a\u74f6\u9838\uff0c\u79d1\u5b78\u5bb6\u5011\u60f3\u51fa\u4e86\u4e00\u500b\u760b\u72c2\u7684idea\uff1a<strong>\u300e\u65e2\u7136\u7d19\u689d\u592a\u5c0f\uff0c\u90a3\u4e7e\u8106\u4e0d\u8b93 Decoder \u6b7b\u80cc\u7d19\u689d\u4e86\uff01\u8b93 Decoder \u5728\u7ffb\u8b6f\u6bcf\u500b\u5b57\u7684\u6642\u5019\uff0c\u81ea\u5df1\u52d5\u614b\u53bb\u56de\u982d\u770b Encoder \u7684\u54ea\u4e9b\u5b57\u6700\u91cd\u8981\uff01\u300f<\/strong>\u2014\u2014\u9019\uff0c\u5c31\u662f\u5f15\u7206\u73fe\u4ee3\u5927\u6a21\u578b\u9769\u547d\u7684\u7d42\u6975\u6280\u8853\uff1a<strong>\u6ce8\u610f\u529b\u6a5f\u5236\uff08Attention Mechanism\uff09<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u666e\u901a\u7684 Seq2Seq \u5728 Decoder \u7ffb\u8b6f\u968e\u6bb5\u6642\uff0cEncoder \u65e9\u5c31\u5df2\u7d93\u4e0b\u73ed\u6536\u5de5\u4e86\uff0cDecoder \u53ea\u80fd\u5b64\u55ae\u5730\u770b\u8457\u90a3\u5f35 Context Vector\u731c\u6e2c\u3002\u800c\u52a0\u4e0a Attention \u4e4b\u5f8c\uff0cEncoder \u6bcf\u500b\u96b1\u85cf\u72c0\u614b\uff08\u62bd\u8c61\u8a9e\u610f\uff09<strong>\u90fd\u6703\u88ab\u59a5\u5584\u4fdd\u5b58\u4e0b\u4f86\uff0c\u505a\u6210\u4e00\u672c\u300c\u6b77\u53f2\u7d00\u9304\u7c3f\u300d<\/strong>\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u7576 Decoder \u6e96\u5099\u5410\u51fa\u4e0b\u4e00\u500b\u5b57\u6642\uff0c\u4fbf\u6703\u62ff\u8457\u81ea\u5df1\u7576\u4e0b\u7684\u72c0\u614b\uff0c\u53bb\u8ddf\u9019\u672c\u7d00\u9304\u7c3f\u9032\u884c\u5c0d\u6bd4\u3001\u8a08\u7b97\u6b0a\u91cd\uff0c\u9019\u5c31\u53eb\u300c<strong>\u5c0d\u7126 focus<\/strong> \u300d\u3002<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"694\" height=\"329\" src=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/7B248ED0-DD18-43B9-A194-5524AB60B9D7.png\" alt=\"\" class=\"wp-image-906\" srcset=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/7B248ED0-DD18-43B9-A194-5524AB60B9D7.png 694w, https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/7B248ED0-DD18-43B9-A194-5524AB60B9D7-300x142.png 300w\" sizes=\"auto, (max-width: 694px) 100vw, 694px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u6ce8\u610f\u529b\u6a5f\u5236<\/strong>\u4e2d\u6700\u91cd\u8981\u7684\u4e09\u500b\u8b8a\u6578\u5206\u5225\u662f Q\u3001K\u3001V:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><em>Q<\/em>\uff08Query\uff0c\u67e5\u8a62\uff09\uff1a<\/strong> \u9019\u662f<strong>Decoder<\/strong> \u767c\u51fa\u7684\u3002\u4ee3\u8868\u300c\u6211\u6b64\u6642\u6b64\u523b\u6b63\u6e96\u5099\u8981\u5410\u51fa\u4e0b\u4e00\u500b\u4e2d\u6587\uff0c\u6211\u9700\u8981\u4ec0\u9ebc\u6a23\u7684\u8cc7\u8a0a\uff1f\u300d<\/li>\n\n\n\n<li><strong><em>K<\/em>\uff08Key\uff0c\u9375\u503c\uff09\uff1a<\/strong> \u9019\u662f <strong>Encoder \u7684\u6b77\u53f2\u7d00\u9304<\/strong>\u3002\u4ee3\u8868\u300c\u6211\u662f\u539f\u6587\u88e1\u7684\u67d0\u500b\u5b57\uff0c\u6211\u9019\u88e1\u5305\u542b\u7684\u662f\u54ea\u7a2e\u8a9e\u7fa9\u7279\u5fb5\uff1f\u300d<\/li>\n\n\n\n<li><strong><em>V<\/em>\uff08Value\uff0c\u6578\u503c\uff09\uff1a<\/strong> \u4e5f\u662f <strong>Encoder \u7684\u6b77\u53f2\u7d00\u9304<\/strong>\u3002\u4ee3\u8868\u300c\u5982\u679c\u6211\u5c0d\u4f60\u6709\u5e6b\u52a9\uff0c\u6211\u771f\u6b63\u8981\u50b3\u905e\u7d66\u4f60\u7684\u5b8c\u6574\u8cc7\u8a0a\u662f\u4ec0\u9ebc\uff1f\u300d<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">\u8209\u500b\u4f8b\u5b50\uff0c\u4f60\u53bb\u8766\u76ae\u641c\u5c0b\u5546\u54c1:<\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li>\u4f60\u5728\u641c\u5c0b\u5217\u8f38\u5165\uff1a<code>\u300c\u6297\u566a\u85cd\u7259\u8033\u6a5f\u300d<\/code> \u2192 \u9019\u5c31\u662f <strong><em>Q<\/em><\/strong>\u3002<\/li>\n\n\n\n<li>\u7cfb\u7d71\u5f8c\u53f0\u6709\u6210\u5343\u4e0a\u842c\u4ef6\u5546\u54c1\u7684\u6a19\u984c\u548c\u6a19\u7c64 <strong>\u2192<\/strong> \u9019\u5c31\u662f <strong><em>K<\/em><\/strong>\u3002<\/li>\n\n\n\n<li>\u7cfb\u7d71\u6703\u62ff\u4f60\u7684 <em>Q <\/em>\u53bb\u8ddf\u6240\u6709\u7684 <em>K <\/em>\u505a\u76f8\u4f3c\u5ea6\u914d\u5c0d\uff08\u8a08\u7b97 <strong>\u9ede\u7a4d Dot Product<\/strong>\uff09\uff0c\u7b97\u51fa\u4f86\u767c\u73fe\u67d0\u6b3e\u8033\u6a5f\u914d\u5c0d\u7387\u9ad8\u9054 95%\uff0c\u67d0\u689d\u62b9\u5e03\u914d\u5c0d\u7387 0% \u2192 \u9019\u5c31\u662f <strong>Attention Score\uff08\u6ce8\u610f\u529b\u6b0a\u91cd\uff09<\/strong>\u3002<\/li>\n\n\n\n<li>\u6700\u5f8c\uff0c\u7cfb\u7d71\u628a\u9019\u4e9b\u5546\u54c1\u771f\u6b63\u7684\u8a73\u7d30\u898f\u683c\u548c\u8cfc\u8cb7\u9023\u7d50 <strong>\u2192<\/strong> <strong><em>V<\/em><\/strong>\uff0c\u6309\u7167\u525b\u624d\u7b97\u51fa\u4f86\u7684\u767e\u5206\u6bd4\u52a0\u6b0a\u6253\u5305\uff0c\u5448\u73fe\u5728\u4f60\u773c\u524d\u3002\u9019\u5c31\u662f <strong>Attention Output<\/strong>\uff01<\/li>\n<\/ol>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h3 class=\"wp-block-heading\" id=\"%e6%bc%94%e7%a4%ba%ef%bc%9aai-%e6%80%8e%e9%ba%bc%e4%b8%80%e9%82%8a%e7%bf%bb%e8%ad%af%e4%b8%80%e9%82%8a%e5%b0%8d%e7%84%a6%ef%bc%9f\">\u6f14\u793a\uff1aAI \u600e\u9ebc\u4e00\u908a\u7ffb\u8b6f\u4e00\u908a\u5c0d\u7126\uff1f<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">\u7e7c\u7e8c\u6cbf\u7528\u958b\u982d\u7684 <code>\"What is your name?\"<\/code> :<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u6b64\u6642\uff0cEncoder \u5df2\u7d93\u628a\u56db\u500b\u5b57\u7684\u8a18\u61b6 (K<sub>1<\/sub>, V<sub>1<\/sub>) \u5230 (K<sub>1<\/sub>, V<sub>4<\/sub>)  \u8a18\u5728\u7d00\u9304\u7c3f\u4e0a\u4e86\u3002<\/p>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>Decoder \u6e96\u5099\u5410\u51fa\u7b2c\u4e00\u500b\u5b57\uff08\u6b64\u6642 Q<sub>1<\/sub> \u51fa\u52d5\uff09\uff1a<\/strong>\n<ul class=\"wp-block-list\">\n<li><strong>Q<sub>1<\/sub><\/strong>\uff08\u6211\u60f3\u5410\u51fa\u4e2d\u6587\u958b\u982d\uff09\u56de\u982d\u53bb\u548c\u7d00\u9304\u7c3f\u88e1\u6240\u6709\u7684<em>K <\/em>\u505a\u914d\u5c0d\u3002<\/li>\n\n\n\n<li>\u6bd4\u5c0d\u7d50\u679c\uff1a<strong>Q<sub>1<\/sub><\/strong> \u767c\u73fe\u8ddf K<sub>3<\/sub>\uff08<code>\"your\"<\/code>\uff09\u7684\u9748\u9b42\u6700\u5951\u5408\uff0c\u95dc\u806f\u5ea6\u9ad8\u9054 80%\uff01\u8ddf K<sub>1<\/sub>\uff08<code>\"What\"<\/code>\uff09\u53ea\u6709 10%\u3002<\/li>\n\n\n\n<li><strong>\u52a0\u6b0a\u6253\u5305\uff1a<\/strong> AI \u628a 80% \u7684\u6ce8\u610f\u529b\u653e\u5728 <code>\"your\"<\/code> \u4e0a\uff0c\u9806\u5229\u5410\u51fa\u7b2c\u4e00\u500b\u5b57\uff1a<code>\u300c\u4f60\u300d<\/code>\u3002<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Decoder \u6e96\u5099\u5410\u51fa\u7b2c\u4e09\u500b\u5b57\uff08\u6b64\u6642 <strong>Q<\/strong><\/strong><sub>3<\/sub><strong> \u51fa\u52d5\uff09\uff1a<\/strong>\n<ul class=\"wp-block-list\">\n<li>\u6b64\u6642 Decoder \u5df2\u7d93\u5410\u51fa\u4e86\u300c\u4f60\u53eb\u300d\uff0c\u5b83\u73fe\u5728\u7684\u72c0\u614b <strong><strong>Q<\/strong><\/strong><sub>3<\/sub> \u4ee3\u8868\uff1a\u300c\u6211\u63a5\u4e0b\u4f86\u60f3\u77e5\u9053\u9019\u53e5\u554f\u53e5\u7684\u6838\u5fc3\u7591\u554f\u8a5e\u662f\u4ec0\u9ebc\uff1f\u300d<\/li>\n\n\n\n<li><strong><strong>Q<\/strong><\/strong><sub>3<\/sub> \u518d\u6b21\u56de\u982d\u53bb\u7ffb\u7d00\u9304\u7c3f\uff0c\u9019\u4e00\u6b21\uff0c\u5b83\u8ddf K<sub>1<\/sub>\uff08<code>\"What\"<\/code>\uff09\u7684\u914d\u5c0d\u7387\u98c6\u5230\u4e86 90%\uff01<\/li>\n\n\n\n<li><strong>\u52a0\u6b0a\u6253\u5305\uff1a<\/strong> \u5b8c\u7f8e\u7684\u628a <code>\"What\"<\/code> \u7684\u7cbe\u83ef\u63d0\u7149\u51fa\u4f86\uff0c\u9806\u5229\u5410\u51fa\uff1a<code>\u300c\u4ec0\u9ebc\u300d<\/code>\u3002<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h1 class=\"wp-block-heading\" id=\"%e7%b5%90\">\u7d50<\/h1>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"724\" height=\"427\" src=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/CF64E9F4-880D-4E0B-8934-7415643B5792.png\" alt=\"\" class=\"wp-image-917\" srcset=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/CF64E9F4-880D-4E0B-8934-7415643B5792.png 724w, https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/07\/CF64E9F4-880D-4E0B-8934-7415643B5792-300x177.png 300w\" sizes=\"auto, (max-width: 724px) 100vw, 724px\" \/><\/figure>\n\n\n\n<ol start=\"1\" class=\"wp-block-list\">\n<li><strong>\u5fb9\u5e95\u6253\u7834\u8cc7\u8a0a\u74f6\u9838\uff1a<\/strong>Decoder \u7ffb\u5230\u7b2c 100 \u500b\u5b57\u6642\uff0c\u4f9d\u7136\u53ef\u4ee5\u900f\u904e Attention \u76f4\u63a5\u56de\u982d\u53bb\u8abf\u95b1 Encoder \u7b2c 1 \u500b\u5b57\u7684\u5b8c\u6574 V\uff08Value\uff09\u3002\u8a18\u61b6\u529b\u4e0d\u518d\u53d7\u9650\u65bc\u90a3\u5f35\u5c0f\u7d19\u689d\uff0c\u9577\u6587\u672c\u7ffb\u8b6f\u54c1\u8cea\u76f4\u63a5\u8d77\u6b7b\u56de\u751f !!<\/li>\n\n\n\n<li><strong>\u5177\u5099\u9a5a\u4eba\u7684\u300c\u53ef\u89e3\u91cb\u6027\u300d\uff08Explainability\uff09\uff1a<\/strong>\u4ee5\u524d\u7684 RNN \u662f\u500b\u9ed1\u76d2\u5b50\uff0c\u6c92\u4eba\u77e5\u9053<strong>\u96b1\u85cf\u72c0\u614b<\/strong>\u88e1\u5230\u5e95\u88dd\u4e86\u4ec0\u9ebc\u3002\u4f46 Attention \u6a5f\u5236\u7b97\u51fa\u4e86\u6e05\u6e05\u695a\u695a\u7684\u300c\u6b0a\u91cd\u767e\u5206\u6bd4\uff080.0 ~ 1.0\uff09\u300d\u3002<br>\u5de5\u7a0b\u5e2b\u53ef\u4ee5\u76f4\u63a5\u628a\u9019\u500b\u6b0a\u91cd\u756b\u6210<strong>\u77e9\u9663\u71b1\u9ede\u5716\uff08Heatmap\uff09<\/strong>\uff0c\u89aa\u773c\u770b\u5230 AI \u5728\u7ffb\u300c\u4ec0\u9ebc\u300d\u7684\u6642\u5019\u773c\u775b\u771f\u7684\u76ef\u8457 <code>\"What\"<\/code> \u770b\u3002\u9019\u5728\u5b78\u8853\u4e0a\u662f\u975e\u5e38\u9707\u64bc\u7684\u8996\u89ba\u8b49\u64da\u3002<\/li>\n\n\n\n<li>Attention \u8b49\u660e\u4e86\u4e00\u4ef6\u4e8b\u2014\u2014<strong>\u60f3\u8981\u9023\u52d5\u524d\u5f8c\u6587\u7684\u8a18\u61b6\uff0c\u6839\u672c\u4e0d\u9700\u8981\u9760 RNN \u4e00\u7ad9\u4e00\u7ad9\u50b3\u8a71\uff01\u76f4\u63a5\u7528 Q, K, V \u9032\u884c\u8de8\u6642\u7a7a\u7684\u77e9\u9663\u77e9\u9663\u76f8\u4e58\uff0c\u5c31\u80fd\u77ac\u9593\u6293\u5230\u5168\u57df\u7684\u95dc\u806f\uff01<\/strong><\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a&#8221;What is your name?&#8221;\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 &#8220;What&#8221; RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u300d\u9019\u7a2e\u300c\u8f38\u5165\u8207\u8f38\u51fa\u9577\u5ea6\u4e0d\u5c0d\u7b49\u3001\u8a9e\u5e8f\u4e0d\u540c\u300d\u7684\u96e3\u984c\uff0cGoogle \u7684\u5718\u968a\u5728 2014 \u5e74\u63d0\u51fa\u4e86\u4e00\u500b\u9769\u547d\u6027\u7684\u6846\u67b6\u2014\u2014Seq2Seq\u3002 Seq2Seq \u7684\u6838\u5fc3\u601d\u60f3\u975e\u5e38\u512a\u96c5\uff0c\u5b83\u628a\u795e\u7d93\u7db2\u8def\u62c6\u6210\u4e86\u5169\u500b\u90e8\u5206\uff1a\u7de8\u78bc\u5668\uff08Encoder\uff09 \u8207 \u89e3\u78bc\u5668\uff08Decoder\uff09\u3002 1. \u7de8\u78bc\u5668\uff08Encoder\uff09\uff1a\u8ca0\u8cac\u300c\u807d\u61c2\u4e26\u6253\u5305\u300d \u6703\u8ca0\u8cac\u628a\u8f38\u5165\u7684\u6574\u53e5\u82f1\u6587\uff08\u6e90\u8a9e\u8a00\uff09\u4e00\u5b57\u4e0d\u6f0f\u5730\u8b80\u5b8c\uff0c\u5c31\u50cf\u500b\u60c5\u5831\u54e1\uff0c\u8b80\u5230 &#8220;I&#8221;\u3001&#8221;love&#8221;\u3001&#8221;learning&#8221;\u2026\u3002\u6bcf\u8b80\u4e00\u500b\u5b57\uff0c\u5b83\u5c31\u628a\u8cc7\u8a0a\u58d3\u7e2e\u9032\u96b1\u85cf\u72c0\u614b\uff08Hidden State\uff09\u88e1\u3002 \u7576\u6574\u53e5\u82f1\u6587\u8b80\u5b8c\u3001\u9047\u5230\u53e5\u5c3e\u7b26\u865f\u6642\uff0cEncoder \u6703\u628a\u524d\u9762\u6240\u6709\u5438\u6536\u5230\u7684\u7cbe\u83ef\uff0c\u58d3\u7e2e\u63d0\u7149\u6210\u4e00\u500b\u6700\u7d42\u7684\u56fa\u5b9a\u5927\u5c0f\u5411\u91cf\uff0c\u53eb\u505a [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":520,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"footnotes":""},"class_list":["post-897","page","type-page","status-publish","hentry"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.10 - aioseo.com -->\n\t<meta name=\"description\" content=\"\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] AI \u8b80\u4e86 3 \u500b\u5b57 =&gt; \u99ac\u4e0a\u5410\u51fa 1 \u500b\u5b57\u3002 \u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 3 \u500b\u5b57 =&gt; \u518d\u5410\u51fa 1 \u500b\u5b57\u3002 \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a&quot;What is your name?&quot;\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 &quot;What&quot; RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"google-site-verification\" content=\"-324YR5tomynX5FeTW2lTMHIX0KmPBvpxjXpOhXwi1Q\" \/>\n\t<link rel=\"canonical\" href=\"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.10\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"HyC Wiki - Technical articles\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005 - HyC Wiki\" \/>\n\t\t<meta property=\"og:description\" content=\"\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] AI \u8b80\u4e86 3 \u500b\u5b57 =&gt; \u99ac\u4e0a\u5410\u51fa 1 \u500b\u5b57\u3002 \u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 3 \u500b\u5b57 =&gt; \u518d\u5410\u51fa 1 \u500b\u5b57\u3002 \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a&quot;What is your name?&quot;\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 &quot;What&quot; RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/\" \/>\n\t\t<meta property=\"og:image\" content=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/06\/cropped-cropped-\u672a\u547d\u540d\u8a2d\u8a08-4.png\" \/>\n\t\t<meta property=\"og:image:secure_url\" content=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/06\/cropped-cropped-\u672a\u547d\u540d\u8a2d\u8a08-4.png\" \/>\n\t\t<meta property=\"og:image:width\" content=\"64\" \/>\n\t\t<meta property=\"og:image:height\" content=\"64\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2026-07-03T16:40:22+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2026-07-04T02:37:06+00:00\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n\t\t<meta name=\"twitter:title\" content=\"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005 - HyC Wiki\" \/>\n\t\t<meta name=\"twitter:description\" content=\"\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] AI \u8b80\u4e86 3 \u500b\u5b57 =&gt; \u99ac\u4e0a\u5410\u51fa 1 \u500b\u5b57\u3002 \u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 3 \u500b\u5b57 =&gt; \u518d\u5410\u51fa 1 \u500b\u5b57\u3002 \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a&quot;What is your name?&quot;\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 &quot;What&quot; RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b\" \/>\n\t\t<meta name=\"twitter:image\" content=\"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/06\/cropped-cropped-\u672a\u547d\u540d\u8a2d\u8a08-4.png\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/#listItem\",\"name\":\"\\u3010RNN\\u5230Agent\\u3011\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/#listItem\",\"position\":2,\"name\":\"\\u3010RNN\\u5230Agent\\u3011\",\"item\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\\\/#listItem\",\"name\":\"2. \\u6ce8\\u610f\\u529b\\u6a5f\\u5236: \\u7834\\u5c40\\u8005\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\\\/#listItem\",\"position\":3,\"name\":\"2. \\u6ce8\\u610f\\u529b\\u6a5f\\u5236: \\u7834\\u5c40\\u8005\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/#listItem\",\"name\":\"\\u3010RNN\\u5230Agent\\u3011\"}}]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/#person\",\"name\":\"H.Y. Chen\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\\\/#personImage\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/fc6e05e080c9ea570267ee9ed68c8b1841d745cee07c0331c5440646e0646603?s=96&d=mm&r=g\",\"width\":96,\"height\":96,\"caption\":\"H.Y. Chen\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\\\/#webpage\",\"url\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\\\/\",\"name\":\"2. \\u6ce8\\u610f\\u529b\\u6a5f\\u5236: \\u7834\\u5c40\\u8005 - HyC Wiki\",\"description\":\"\\u5728\\u4e0a\\u7bc7\\u7684\\u5be6\\u9a57\\u7a0b\\u5f0f\\u78bc\\u4e2d\\uff0c\\u6838\\u5fc3\\u7684\\u908f\\u8f2f\\u662f\\u9019\\u4e00\\u884c\\uff1a input_seq = input_seq[1:] + [next_char_id] AI \\u8b80\\u4e86 3 \\u500b\\u5b57 => \\u99ac\\u4e0a\\u5410\\u51fa 1 \\u500b\\u5b57\\u3002 \\u63a5\\u8457\\uff0c\\u628a\\u65b0\\u5b57\\u52a0\\u9032\\u53bb\\uff0c\\u518d\\u8b80 3 \\u500b\\u5b57 => \\u518d\\u5410\\u51fa 1 \\u500b\\u5b57\\u3002 \\u4e0d\\u8ad6\\u4f60\\u8b93\\u5b83\\u5410\\u51fa\\u591a\\u9577\\u7684\\u53e5\\u5b50\\uff0c\\u5728\\u5b83\\u7684\\u904b\\u4f5c\\u6a5f\\u5236\\u88e1\\uff0c\\u300c\\u9032\\u53bb\\u5e7e\\u500b\\u5b57\\u3001\\u51fa\\u4f86\\u5e7e\\u500b\\u5b57\\u300d\\u7684\\u6bd4\\u4f8b\\u662f\\u6b7b\\u6b7b\\u56fa\\u5b9a\\u4f4f\\u7684!\\u5982\\u679c\\u628a\\u9019\\u7a2e\\u300c\\u4e00\\u9032\\u4e00\\u51fa\\u300d\\u7684 RNN \\u62ff\\u4f86\\u505a\\u300c\\u82f1\\u7ffb\\u4e2d\\u300d\\uff0c\\u6703\\u767c\\u751f\\u4ec0\\u9ebc\\u4e8b\\u5462?\\u5047\\u8a2d\\u7ffb\\u8b6f\\uff1a\\\"What is your name?\\\"\\uff084 \\u500b\\u5b57\\uff09\\u4e2d\\u6587\\u662f\\uff1a\\u300c\\u4f60\\u53eb\\u4ec0\\u9ebc\\u540d\\u5b57\\uff1f\\u300d\\uff085 \\u500b\\u5b57\\uff09 AI \\u8b80\\u5165 \\\"What\\\" RNN \\u88ab\\u903c\\u8457\\u7576\\u5834\\u8981\\u5410\\u51fa\\u4e2d\\u6587\\uff0c\\u6700\\u7d42\\u7ffb\\u51fa\\u4f86\\u7684\\u7d50\\u679c\\u5c31\\u6703\\u8b8a\\u6210\\uff1a\\u300c\\u4ec0\\u9ebc \\u662f \\u4f60\\u7684 \\u540d\\u5b57\\u300d\\uff08\\u525b\\u5b78\\u4e2d\\u6587\\u7684\\u8001\\u5916\\uff09\\u3002 \\u5728\\u540c\\u4e00\\u500b\\u6642\\u9593\\u6b65\\uff08Time Step\\uff09\\u88e1\\uff0c\\u8f38\\u5165\\u4e00\\u500b Token\\uff0c\\u5c31\\u5fc5\\u9808\\u5c0d\\u61c9\\u8f38\\u51fa\\u4e00\\u500b Token\\u3002\\u4f60\\u8f38\\u5165\\u7684\\u5e8f\\u5217\\u6709\\u591a\\u9577\\uff0c\\u7522\\u51fa\\u7684\\u5e8f\\u5217\\u5c31\\u5fc5\\u9808\\u7b49\\u9577\\uff08\\u6216\\u662f\\u5448\\u56fa\\u5b9a\\u6bd4\\u4f8b\\uff09\\uff0c\\u5169\\u8005\\u5728\\u6642\\u9593\\u8ef8\\u4e0a\\u662f\\u540c\\u6b65\\u7d81\\u6b7b\\u7684\\uff08Synchronous\\uff09\\u3002 *\\u8a3b \\u4ee5\\u4e0b\\u5167\\u6587\\u5716\\u7247\\u7686\\u51fa\\u81ea\\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\\u9019\\u7bc7\\u8ad6\\u6587 Seq2Seq \\u70ba\\u4e86\\u89e3\\u6c7a\\u300c\\u5728\\u540c\\u4e00\\u500b\\u6642\\u9593\\u6b65\\uff08Time Step\\uff09\\u88e1\\uff0c\\u8f38\\u5165\\u4e00\\u500b Token\\uff0c\\u5c31\\u5fc5\\u9808\\u5c0d\\u61c9\\u8f38\\u51fa\\u4e00\\u500b\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/llm-agent\\\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\\\/#breadcrumblist\"},\"datePublished\":\"2026-07-03T16:40:22+00:00\",\"dateModified\":\"2026-07-04T02:37:06+00:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/#website\",\"url\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/\",\"name\":\"HyC Wiki\",\"description\":\"Technical articles\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/hyc.eshachem.com\\\/program\\\/#person\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005 - HyC Wiki","description":"\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] AI \u8b80\u4e86 3 \u500b\u5b57 => \u99ac\u4e0a\u5410\u51fa 1 \u500b\u5b57\u3002 \u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 3 \u500b\u5b57 => \u518d\u5410\u51fa 1 \u500b\u5b57\u3002 \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a\"What is your name?\"\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 \"What\" RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b","canonical_url":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"google-site-verification":"-324YR5tomynX5FeTW2lTMHIX0KmPBvpxjXpOhXwi1Q","miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"BreadcrumbList","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/hyc.eshachem.com\/program#listItem","position":1,"name":"Home","item":"https:\/\/hyc.eshachem.com\/program","nextItem":{"@type":"ListItem","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/#listItem","name":"\u3010RNN\u5230Agent\u3011"}},{"@type":"ListItem","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/#listItem","position":2,"name":"\u3010RNN\u5230Agent\u3011","item":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/","nextItem":{"@type":"ListItem","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/#listItem","name":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005"},"previousItem":{"@type":"ListItem","@id":"https:\/\/hyc.eshachem.com\/program#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/#listItem","position":3,"name":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005","previousItem":{"@type":"ListItem","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/#listItem","name":"\u3010RNN\u5230Agent\u3011"}}]},{"@type":"Person","@id":"https:\/\/hyc.eshachem.com\/program\/#person","name":"H.Y. Chen","image":{"@type":"ImageObject","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/#personImage","url":"https:\/\/secure.gravatar.com\/avatar\/fc6e05e080c9ea570267ee9ed68c8b1841d745cee07c0331c5440646e0646603?s=96&d=mm&r=g","width":96,"height":96,"caption":"H.Y. Chen"}},{"@type":"WebPage","@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/#webpage","url":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/","name":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005 - HyC Wiki","description":"\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] AI \u8b80\u4e86 3 \u500b\u5b57 => \u99ac\u4e0a\u5410\u51fa 1 \u500b\u5b57\u3002 \u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 3 \u500b\u5b57 => \u518d\u5410\u51fa 1 \u500b\u5b57\u3002 \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a\"What is your name?\"\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 \"What\" RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/hyc.eshachem.com\/program\/#website"},"breadcrumb":{"@id":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/#breadcrumblist"},"datePublished":"2026-07-03T16:40:22+00:00","dateModified":"2026-07-04T02:37:06+00:00"},{"@type":"WebSite","@id":"https:\/\/hyc.eshachem.com\/program\/#website","url":"https:\/\/hyc.eshachem.com\/program\/","name":"HyC Wiki","description":"Technical articles","inLanguage":"en-US","publisher":{"@id":"https:\/\/hyc.eshachem.com\/program\/#person"}}]},"og:locale":"en_US","og:site_name":"HyC Wiki - Technical articles","og:type":"article","og:title":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005 - HyC Wiki","og:description":"\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] AI \u8b80\u4e86 3 \u500b\u5b57 =&gt; \u99ac\u4e0a\u5410\u51fa 1 \u500b\u5b57\u3002 \u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 3 \u500b\u5b57 =&gt; \u518d\u5410\u51fa 1 \u500b\u5b57\u3002 \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a&quot;What is your name?&quot;\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 &quot;What&quot; RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b","og:url":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/","og:image":"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/06\/cropped-cropped-\u672a\u547d\u540d\u8a2d\u8a08-4.png","og:image:secure_url":"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/06\/cropped-cropped-\u672a\u547d\u540d\u8a2d\u8a08-4.png","og:image:width":64,"og:image:height":64,"article:published_time":"2026-07-03T16:40:22+00:00","article:modified_time":"2026-07-04T02:37:06+00:00","twitter:card":"summary_large_image","twitter:title":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005 - HyC Wiki","twitter:description":"\u5728\u4e0a\u7bc7\u7684\u5be6\u9a57\u7a0b\u5f0f\u78bc\u4e2d\uff0c\u6838\u5fc3\u7684\u908f\u8f2f\u662f\u9019\u4e00\u884c\uff1a input_seq = input_seq[1:] + [next_char_id] AI \u8b80\u4e86 3 \u500b\u5b57 =&gt; \u99ac\u4e0a\u5410\u51fa 1 \u500b\u5b57\u3002 \u63a5\u8457\uff0c\u628a\u65b0\u5b57\u52a0\u9032\u53bb\uff0c\u518d\u8b80 3 \u500b\u5b57 =&gt; \u518d\u5410\u51fa 1 \u500b\u5b57\u3002 \u4e0d\u8ad6\u4f60\u8b93\u5b83\u5410\u51fa\u591a\u9577\u7684\u53e5\u5b50\uff0c\u5728\u5b83\u7684\u904b\u4f5c\u6a5f\u5236\u88e1\uff0c\u300c\u9032\u53bb\u5e7e\u500b\u5b57\u3001\u51fa\u4f86\u5e7e\u500b\u5b57\u300d\u7684\u6bd4\u4f8b\u662f\u6b7b\u6b7b\u56fa\u5b9a\u4f4f\u7684!\u5982\u679c\u628a\u9019\u7a2e\u300c\u4e00\u9032\u4e00\u51fa\u300d\u7684 RNN \u62ff\u4f86\u505a\u300c\u82f1\u7ffb\u4e2d\u300d\uff0c\u6703\u767c\u751f\u4ec0\u9ebc\u4e8b\u5462?\u5047\u8a2d\u7ffb\u8b6f\uff1a&quot;What is your name?&quot;\uff084 \u500b\u5b57\uff09\u4e2d\u6587\u662f\uff1a\u300c\u4f60\u53eb\u4ec0\u9ebc\u540d\u5b57\uff1f\u300d\uff085 \u500b\u5b57\uff09 AI \u8b80\u5165 &quot;What&quot; RNN \u88ab\u903c\u8457\u7576\u5834\u8981\u5410\u51fa\u4e2d\u6587\uff0c\u6700\u7d42\u7ffb\u51fa\u4f86\u7684\u7d50\u679c\u5c31\u6703\u8b8a\u6210\uff1a\u300c\u4ec0\u9ebc \u662f \u4f60\u7684 \u540d\u5b57\u300d\uff08\u525b\u5b78\u4e2d\u6587\u7684\u8001\u5916\uff09\u3002 \u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b Token\u3002\u4f60\u8f38\u5165\u7684\u5e8f\u5217\u6709\u591a\u9577\uff0c\u7522\u51fa\u7684\u5e8f\u5217\u5c31\u5fc5\u9808\u7b49\u9577\uff08\u6216\u662f\u5448\u56fa\u5b9a\u6bd4\u4f8b\uff09\uff0c\u5169\u8005\u5728\u6642\u9593\u8ef8\u4e0a\u662f\u540c\u6b65\u7d81\u6b7b\u7684\uff08Synchronous\uff09\u3002 *\u8a3b \u4ee5\u4e0b\u5167\u6587\u5716\u7247\u7686\u51fa\u81ea\u65bcRecurrent Neural Networks (RNNs): A gentle Introduction and Overview\u9019\u7bc7\u8ad6\u6587 Seq2Seq \u70ba\u4e86\u89e3\u6c7a\u300c\u5728\u540c\u4e00\u500b\u6642\u9593\u6b65\uff08Time Step\uff09\u88e1\uff0c\u8f38\u5165\u4e00\u500b Token\uff0c\u5c31\u5fc5\u9808\u5c0d\u61c9\u8f38\u51fa\u4e00\u500b","twitter:image":"https:\/\/hyc.eshachem.com\/program\/wp-content\/uploads\/2026\/06\/cropped-cropped-\u672a\u547d\u540d\u8a2d\u8a08-4.png"},"aioseo_meta_data":{"post_id":"897","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_custom_url":null,"og_image_custom_fields":null,"og_image_url":null,"og_image_width":null,"og_image_height":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_image_url":null,"twitter_title":null,"twitter_description":null,"schema_type":"default","schema_type_options":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"limit_modified_date":false,"ai":null,"breadcrumb_settings":null,"seo_analyzer_scan_date":null,"created":"2026-07-28 14:29:00","updated":"2026-07-28 14:29:00"},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/hyc.eshachem.com\/program\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/hyc.eshachem.com\/program\/llm-agent\/\" title=\"\u3010RNN\u5230Agent\u3011\">\u3010RNN\u5230Agent\u3011<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/hyc.eshachem.com\/program"},{"label":"\u3010RNN\u5230Agent\u3011","link":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/"},{"label":"2. \u6ce8\u610f\u529b\u6a5f\u5236: \u7834\u5c40\u8005","link":"https:\/\/hyc.eshachem.com\/program\/llm-agent\/2-%e6%b3%a8%e6%84%8f%e5%8a%9b%e6%a9%9f%e5%88%b6-%e7%a0%b4%e5%b1%80%e8%80%85\/"}],"_links":{"self":[{"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/pages\/897","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/comments?post=897"}],"version-history":[{"count":8,"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/pages\/897\/revisions"}],"predecessor-version":[{"id":918,"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/pages\/897\/revisions\/918"}],"up":[{"embeddable":true,"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/pages\/520"}],"wp:attachment":[{"href":"https:\/\/hyc.eshachem.com\/program\/wp-json\/wp\/v2\/media?parent=897"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}