| … | … | @@ -215,8 +215,13 @@ Link Grammar |
| 215 | 215 | \begin_layout Standard |
| 216 | 216 | I won't explain what Link Grammar (LG) is, or how it works. |
| 217 | 217 | Read the docs. |
| 218 | | However, I want to write down a a Hamiltonian for it, which is something |
| 219 | | that the Link Grammar docs do not do. |
| 218 | (Note: I do end up explaining much of it, further below. |
| 219 | It's unavoidable.) |
| 220 | \end_layout |
| 221 | |
| 222 | \begin_layout Standard |
| 223 | I want to write down a Hamiltonian for it, which is something that the Link |
| 224 | Grammar docs do not do. |
| 220 | 225 | It is analogous to the Ising Model Hamiltonian: |
| 221 | 226 | \begin_inset Formula |
| 222 | 227 | \[ |
| … | … | @@ -1294,6 +1299,16 @@ chased+ |
| 1294 | 1299 | \end_inset |
| 1295 | 1300 | |
| 1296 | 1301 | . |
| 1302 | The ampersand |
| 1303 | \begin_inset Formula $\&$ |
| 1304 | \end_inset |
| 1305 | |
| 1306 | was used in place of the tensor |
| 1307 | \begin_inset Formula $\otimes$ |
| 1308 | \end_inset |
| 1309 | |
| 1310 | otimes symbol. |
| 1311 | This is in keeping with Link Grammar. |
| 1297 | 1312 | \end_layout |
| 1298 | 1313 | |
| 1299 | 1314 | \begin_layout Standard |
| … | … | @@ -1310,6 +1325,24 @@ ing BERT. |
| 1310 | 1325 | Soo.... |
| 1311 | 1326 | \end_layout |
| 1312 | 1327 | |
| 1328 | \begin_layout Section* |
| 1329 | Training |
| 1330 | \end_layout |
| 1331 | |
| 1332 | \begin_layout Standard |
| 1333 | So, armed with a definition of a disjunct that closely resembles a BERT–style |
| 1334 | skip–gram, can we invent a training technique that avoids the standard |
| 1335 | transformer foot–path? That is, the goal here is to ask |
| 1336 | \begin_inset Quotes eld |
| 1337 | \end_inset |
| 1338 | |
| 1339 | is there another way, and what might it be? |
| 1340 | \begin_inset Quotes erd |
| 1341 | \end_inset |
| 1342 | |
| 1343 | |
| 1344 | \end_layout |
| 1345 | |
| 1313 | 1346 | \begin_layout Section* |
| 1314 | 1347 | The End |
| 1315 | 1348 | \end_layout |