| Visible device: cuda |
| Seed used: 0 |
| Batch size: 64 |
| Epochs: 40 |
| Learning rate: 1e-05 |
| Entropy weight: 0.01 |
| Regularization weight: 0.0 |
| Only use multiwoz like domains: False |
| Vectorizer: Data set used is multiwoz21 |
| We filter state by active domains: True |
| Vectorizer: Data set used is multiwoz21 |
| Embedding semantic descriptions: True |
| Embedded descriptions successfully. Size: torch.Size([338, 768]) |
| Data set used for descriptions: multiwoz21 |
| We use Roberta to embed actions. |
| Didnt load a model |
| Start training |
| Epoch: 0 |
| Precision: 0 |
| Recall: 0 |
| F1: 0 |
| Best Precision: 0.0 |
| Best Recall: 0.0 |
| Best F1: 0.0 |
| Epoch: 1 |
| Precision: 0 |
| Recall: 0 |
| F1: 0 |
| Best Precision: 0.0 |
| Best Recall: 0.0 |
| Best F1: 0.0 |
| Epoch: 2 |
| Average actions: 2.4348959922790527 |
| Average target actions: 2.28125 |
| Precision: 0.043010752688172046 |
| Recall: 0.0425531914893617 |
| F1: 0.04278074866310161 |
| <<dialog policy>> epoch 2: saved network to mdl |
| Best Precision: 0.043010752688172046 |
| Best Recall: 0.0425531914893617 |
| Best F1: 0.04278074866310161 |
| Epoch: 3 |
| Precision: 0.043010752688172046 |
| Recall: 0.0425531914893617 |
| F1: 0.04278074866310161 |
| Best Precision: 0.043010752688172046 |
| Best Recall: 0.0425531914893617 |
| Best F1: 0.04278074866310161 |
| Epoch: 4 |
| Average actions: 2.4114584922790527 |
| Average target actions: 2.7890625 |
| Precision: 0.07058823529411765 |
| Recall: 0.06382978723404255 |
| F1: 0.06703910614525138 |
| <<dialog policy>> epoch 4: saved network to mdl |
| Best Precision: 0.07058823529411765 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06703910614525138 |
| Epoch: 5 |
| Precision: 0.07058823529411765 |
| Recall: 0.06382978723404255 |
| F1: 0.06703910614525138 |
| Best Precision: 0.07058823529411765 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06703910614525138 |
| Epoch: 6 |
| Average actions: 2.1536459922790527 |
| Average target actions: 2.5859375 |
| Precision: 0.049079754601226995 |
| Recall: 0.0425531914893617 |
| F1: 0.045584045584045586 |
| Best Precision: 0.07058823529411765 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06703910614525138 |
| Epoch: 7 |
| Precision: 0.049079754601226995 |
| Recall: 0.0425531914893617 |
| F1: 0.045584045584045586 |
| Best Precision: 0.07058823529411765 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06703910614525138 |
| Epoch: 8 |
| Average actions: 2.15625 |
| Average target actions: 2.5520834922790527 |
| Precision: 0.07547169811320754 |
| Recall: 0.06382978723404255 |
| F1: 0.06916426512968299 |
| <<dialog policy>> epoch 8: saved network to mdl |
| Best Precision: 0.07547169811320754 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06916426512968299 |
| Epoch: 9 |
| Precision: 0.07547169811320754 |
| Recall: 0.06382978723404255 |
| F1: 0.06916426512968299 |
| Best Precision: 0.07547169811320754 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06916426512968299 |
| Epoch: 10 |
| Average actions: 2.0572915077209473 |
| Average target actions: 2.3489584922790527 |
| Precision: 0.04516129032258064 |
| Recall: 0.03723404255319149 |
| F1: 0.04081632653061224 |
| Best Precision: 0.07547169811320754 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06916426512968299 |
| Epoch: 11 |
| Precision: 0.04516129032258064 |
| Recall: 0.03723404255319149 |
| F1: 0.04081632653061224 |
| Best Precision: 0.07547169811320754 |
| Best Recall: 0.06382978723404255 |
| Best F1: 0.06916426512968299 |
| Epoch: 12 |
| Average actions: 1.984375 |
| Average target actions: 2.5520834922790527 |
| Precision: 0.08666666666666667 |
| Recall: 0.06914893617021277 |
| F1: 0.07692307692307691 |
| <<dialog policy>> epoch 12: saved network to mdl |
| Best Precision: 0.08666666666666667 |
| Best Recall: 0.06914893617021277 |
| Best F1: 0.07692307692307691 |
| Epoch: 13 |
| Precision: 0.08666666666666667 |
| Recall: 0.06914893617021277 |
| F1: 0.07692307692307691 |
| Best Precision: 0.08666666666666667 |
| Best Recall: 0.06914893617021277 |
| Best F1: 0.07692307692307691 |
| Epoch: 14 |
| Average actions: 2.0416665077209473 |
| Average target actions: 2.3828125 |
| Precision: 0.05228758169934641 |
| Recall: 0.0425531914893617 |
| F1: 0.046920821114369494 |
| Best Precision: 0.08666666666666667 |
| Best Recall: 0.06914893617021277 |
| Best F1: 0.07692307692307691 |
| Epoch: 15 |
| Precision: 0.05228758169934641 |
| Recall: 0.0425531914893617 |
| F1: 0.046920821114369494 |
| Best Precision: 0.08666666666666667 |
| Best Recall: 0.06914893617021277 |
| Best F1: 0.07692307692307691 |
| Epoch: 16 |
| Average actions: 2.1666665077209473 |
| Average target actions: 2.2135417461395264 |
| Precision: 0.1346153846153846 |
| Recall: 0.11170212765957446 |
| F1: 0.12209302325581395 |
| <<dialog policy>> epoch 16: saved network to mdl |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 17 |
| Precision: 0.1346153846153846 |
| Recall: 0.11170212765957446 |
| F1: 0.12209302325581395 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 18 |
| Average actions: 1.7734375 |
| Average target actions: 2.5520834922790527 |
| Precision: 0.0661764705882353 |
| Recall: 0.047872340425531915 |
| F1: 0.05555555555555556 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 19 |
| Precision: 0.0661764705882353 |
| Recall: 0.047872340425531915 |
| F1: 0.05555555555555556 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 20 |
| Average actions: 2.1328125 |
| Average target actions: 2.6197917461395264 |
| Precision: 0.1346153846153846 |
| Recall: 0.11170212765957446 |
| F1: 0.12209302325581395 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 21 |
| Precision: 0.1346153846153846 |
| Recall: 0.11170212765957446 |
| F1: 0.12209302325581395 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 22 |
| Average actions: 1.9296875 |
| Average target actions: 2.1119792461395264 |
| Precision: 0.08391608391608392 |
| Recall: 0.06382978723404255 |
| F1: 0.07250755287009063 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 23 |
| Precision: 0.08391608391608392 |
| Recall: 0.06382978723404255 |
| F1: 0.07250755287009063 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 24 |
| Average actions: 2.2213540077209473 |
| Average target actions: 2.3151042461395264 |
| Precision: 0.09815950920245399 |
| Recall: 0.0851063829787234 |
| F1: 0.09116809116809117 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 25 |
| Precision: 0.09815950920245399 |
| Recall: 0.0851063829787234 |
| F1: 0.09116809116809117 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 26 |
| Average actions: 2.1171875 |
| Average target actions: 2.7890625 |
| Precision: 0.12987012987012986 |
| Recall: 0.10638297872340426 |
| F1: 0.11695906432748537 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 27 |
| Precision: 0.12987012987012986 |
| Recall: 0.10638297872340426 |
| F1: 0.11695906432748537 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 28 |
| Average actions: 1.7734375 |
| Average target actions: 2.484375 |
| Precision: 0.08823529411764706 |
| Recall: 0.06382978723404255 |
| F1: 0.07407407407407407 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 29 |
| Precision: 0.08823529411764706 |
| Recall: 0.06382978723404255 |
| F1: 0.07407407407407407 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 30 |
| Average actions: 2.1822915077209473 |
| Average target actions: 2.3489584922790527 |
| Precision: 0.10126582278481013 |
| Recall: 0.0851063829787234 |
| F1: 0.09248554913294797 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 31 |
| Precision: 0.10126582278481013 |
| Recall: 0.0851063829787234 |
| F1: 0.09248554913294797 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 32 |
| Average actions: 2.0442707538604736 |
| Average target actions: 2.6197917461395264 |
| Precision: 0.12345679012345678 |
| Recall: 0.10638297872340426 |
| F1: 0.11428571428571428 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 33 |
| Precision: 0.12345679012345678 |
| Recall: 0.10638297872340426 |
| F1: 0.11428571428571428 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 34 |
| Average actions: 1.8307292461395264 |
| Average target actions: 2.5859375 |
| Precision: 0.11510791366906475 |
| Recall: 0.0851063829787234 |
| F1: 0.09785932721712538 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 35 |
| Precision: 0.11510791366906475 |
| Recall: 0.0851063829787234 |
| F1: 0.09785932721712538 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11170212765957446 |
| Best F1: 0.12209302325581395 |
| Epoch: 36 |
| Average actions: 2.2838540077209473 |
| Average target actions: 2.3489584922790527 |
| Precision: 0.1286549707602339 |
| Recall: 0.11702127659574468 |
| F1: 0.12256267409470752 |
| <<dialog policy>> epoch 36: saved network to mdl |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11702127659574468 |
| Best F1: 0.12256267409470752 |
| Epoch: 37 |
| Precision: 0.1286549707602339 |
| Recall: 0.11702127659574468 |
| F1: 0.12256267409470752 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11702127659574468 |
| Best F1: 0.12256267409470752 |
| Epoch: 38 |
| Average actions: 1.9479167461395264 |
| Average target actions: 2.7552084922790527 |
| Precision: 0.12337662337662338 |
| Recall: 0.10106382978723404 |
| F1: 0.1111111111111111 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11702127659574468 |
| Best F1: 0.12256267409470752 |
| Epoch: 39 |
| Precision: 0.12337662337662338 |
| Recall: 0.10106382978723404 |
| F1: 0.1111111111111111 |
| Best Precision: 0.1346153846153846 |
| Best Recall: 0.11702127659574468 |
| Best F1: 0.12256267409470752 |
|
|
