File size: 20,694 Bytes
d187b57 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 |
Starting training with configuration:
======================================
Error log: logs/error_20250401_104945.log
PYTHONPATH: :/home/deeptanshul/Toxic-Comment-Classification-using-Deep-Learning
======================================
Starting training in background...
Training process started with PID: 7731
Monitor commands:
1. View error log: tail -f logs/error_20250401_104945.log
2. Check process status: ps -p 7731
3. Stop training: kill 7731
Warning: TF32 not supported on this GPU. Disabling.
Error during training: Missing label columns in dataset: ['toxic', 'severe_toxic', 'obscene', 'threat', 'insult', 'identity_hate']
Performing cleanup...
Fatal error: Missing label columns in dataset: ['toxic', 'severe_toxic', 'obscene', 'threat', 'insult', 'identity_hate']
Performing cleanup...
Performing cleanup...
Warning: TF32 not supported on this GPU. Disabling.
Initialized dataset with 285264 samples
Loading sample 147000
Loading sample 225000
Loading sample 4000
Loading sample 86000
Loading sample 50000
Loading sample 144000
Loading sample 42000
Loading sample 244000
Loading sample 229000
Loading sample 210000
Loading sample 116000
Loading sample 278000
Loading sample 154000
Loading sample 227000
Loading sample 272000
Loading sample 224000
Loading sample 237000
Loading sample 77000
Loading sample 134000
Loading sample 201000
Loading sample 211000
Loading sample 65000
Loading sample 231000
Loading sample 194000
Loading sample 200000
Loading sample 153000
Loading sample 211000
Loading sample 195000
Loading sample 59000
Loading sample 134000
Loading sample 5000
Loading sample 264000
Loading sample 9000
Loading sample 273000
Loading sample 114000
Loading sample 20000
Loading sample 240000
Loading sample 39000
Loading sample 195000
Loading sample 263000
Loading sample 265000
Loading sample 119000
Loading sample 15000
Loading sample 30000
Loading sample 141000
Loading sample 28000
Loading sample 94000
Loading sample 157000
Loading sample 185000
Loading sample 227000
Loading sample 132000
Loading sample 152000
Loading sample 15000
Loading sample 192000
Loading sample 211000
Loading sample 173000
Loading sample 67000
Loading sample 200000
Loading sample 52000
Loading sample 280000
Loading sample 0
Loading sample 157000
Loading sample 72000
Loading sample 278000
Loading sample 198000
Loading sample 179000
Loading sample 27000
Loading sample 33000
Loading sample 221000
Loading sample 231000
Loading sample 144000
Loading sample 235000
Loading sample 42000
Loading sample 155000
Loading sample 155000
Loading sample 8000
Loading sample 201000
Loading sample 191000
Loading sample 151000
Loading sample 71000
Loading sample 218000
Loading sample 283000
Loading sample 171000
Loading sample 47000
Loading sample 57000
Loading sample 244000
Loading sample 245000
Loading sample 211000
Loading sample 28000
Loading sample 253000
Loading sample 35000
Loading sample 205000
Loading sample 179000
Loading sample 50000
Loading sample 111000
Loading sample 85000
Loading sample 30000
Loading sample 97000
Loading sample 254000
Loading sample 10000
Loading sample 136000
Loading sample 52000
Loading sample 85000
Loading sample 1000
Loading sample 220000
Loading sample 165000
Loading sample 234000
Loading sample 162000
Loading sample 270000
Loading sample 92000
Loading sample 29000
Loading sample 105000
Loading sample 60000
Loading sample 85000
Loading sample 11000
Loading sample 8000
Loading sample 192000
Loading sample 46000
Loading sample 65000
Loading sample 166000
Loading sample 110000
Loading sample 14000
Loading sample 95000
Loading sample 149000
Loading sample 24000
Loading sample 122000
Loading sample 184000
Loading sample 266000
Loading sample 48000
Loading sample 259000
Loading sample 275000
Loading sample 65000
Loading sample 224000
Loading sample 250000
Loading sample 161000
Loading sample 128000
Loading sample 87000
Loading sample 17000
Loading sample 280000
Loading sample 152000
Loading sample 35000
Loading sample 228000
Loading sample 27000
Loading sample 209000
Loading sample 261000
Loading sample 197000
Loading sample 210000
Loading sample 260000
Loading sample 256000
Loading sample 204000
Loading sample 276000
Loading sample 266000
Loading sample 229000
Loading sample 0
Loading sample 180000
Loading sample 66000
Loading sample 198000
Loading sample 267000
Loading sample 79000
Loading sample 281000
Loading sample 234000
Loading sample 168000
Loading sample 113000
Loading sample 153000
Loading sample 59000
Loading sample 82000
Loading sample 254000
Loading sample 168000
Loading sample 201000
Loading sample 183000
Loading sample 56000
Loading sample 54000
Loading sample 116000
Loading sample 42000
Loading sample 141000
Loading sample 247000
Loading sample 201000
Loading sample 259000
Loading sample 123000
Loading sample 15000
Loading sample 235000
Loading sample 58000
Loading sample 89000
Loading sample 176000
Loading sample 117000
Loading sample 149000
Loading sample 121000
Loading sample 33000
Loading sample 118000
Loading sample 71000
Loading sample 53000
Loading sample 25000
Loading sample 180000
Loading sample 112000
Loading sample 222000
Loading sample 199000
Loading sample 37000
Loading sample 56000
Loading sample 145000
Loading sample 60000
Loading sample 187000
Loading sample 242000
Loading sample 49000
Loading sample 46000
Loading sample 251000
Loading sample 274000
Loading sample 122000
Loading sample 121000
Loading sample 19000
Loading sample 102000
Loading sample 229000
Loading sample 145000
Loading sample 35000
Loading sample 130000
Loading sample 57000
Loading sample 135000
Loading sample 169000
Loading sample 74000
Loading sample 243000
Loading sample 114000
Loading sample 255000
Loading sample 212000
Loading sample 206000
Loading sample 26000
Loading sample 212000
Loading sample 270000
Loading sample 54000
Loading sample 40000
Loading sample 95000
Loading sample 277000
Loading sample 37000
Loading sample 190000
Loading sample 175000
Loading sample 100000
Loading sample 107000
Loading sample 280000
Loading sample 13000
Loading sample 200000
Loading sample 272000
Loading sample 61000
Loading sample 92000
Loading sample 60000
Loading sample 101000
Loading sample 171000
Loading sample 23000
Loading sample 156000
Loading sample 101000
Loading sample 170000
Loading sample 258000
Loading sample 0
Loading sample 71000
Loading sample 236000
Loading sample 22000
Loading sample 7000
Loading sample 25000
Loading sample 95000
Loading sample 77000
Loading sample 85000
Loading sample 144000
Loading sample 38000
Loading sample 24000
Loading sample 87000
Loading sample 201000
Loading sample 70000
Loading sample 12000
Loading sample 100000
Loading sample 223000
Loading sample 209000
Loading sample 272000
Loading sample 233000
Loading sample 2000
Loading sample 206000
Loading sample 55000
Loading sample 110000
Loading sample 271000
Loading sample 163000
Loading sample 198000
Loading sample 109000
Loading sample 39000
Loading sample 228000
Loading sample 181000
Loading sample 231000
Loading sample 158000
Loading sample 272000
Loading sample 105000
Loading sample 92000
Loading sample 225000
Loading sample 213000
Loading sample 38000
Loading sample 258000
Loading sample 209000
Loading sample 172000
Loading sample 137000
Loading sample 187000
Loading sample 38000
Loading sample 93000
Loading sample 42000
Loading sample 53000
Loading sample 165000
Loading sample 222000
Loading sample 68000
Loading sample 224000
Loading sample 23000
Loading sample 207000
Loading sample 177000
Loading sample 108000
Loading sample 261000
Loading sample 205000
Loading sample 164000
Loading sample 132000
Loading sample 126000
Loading sample 282000
Loading sample 32000
Loading sample 263000
Loading sample 157000
Loading sample 28000
Loading sample 4000
Loading sample 103000
Loading sample 181000
Loading sample 27000
Loading sample 35000
Loading sample 100000
Loading sample 3000
Loading sample 262000
Loading sample 187000
Loading sample 148000
Loading sample 6000
Loading sample 58000
Loading sample 157000
Loading sample 120000
Loading sample 62000
Loading sample 242000
Loading sample 61000
Loading sample 145000
Loading sample 237000
Loading sample 66000
Loading sample 141000
Loading sample 54000
Loading sample 62000
Loading sample 189000
Loading sample 85000
Loading sample 39000
Loading sample 80000
Loading sample 231000
Loading sample 260000
Loading sample 121000
Loading sample 210000
Loading sample 233000
Loading sample 194000
Loading sample 204000
Loading sample 37000
Loading sample 228000
Loading sample 259000
Loading sample 129000
Loading sample 188000
Loading sample 77000
Loading sample 127000
Loading sample 278000
Loading sample 256000
Loading sample 263000
Loading sample 232000
Loading sample 242000
Loading sample 50000
Loading sample 154000
Loading sample 76000
Loading sample 199000
Loading sample 177000
Loading sample 223000
Loading sample 222000
Loading sample 0
Loading sample 209000
Loading sample 62000
Loading sample 250000
Loading sample 8000
Loading sample 161000
Loading sample 45000
Loading sample 155000
Loading sample 86000
Loading sample 261000
Loading sample 71000
Loading sample 268000
Loading sample 36000
Loading sample 209000
Loading sample 64000
Loading sample 106000
Loading sample 89000
Loading sample 8000
Loading sample 199000
Loading sample 177000
Loading sample 247000
Loading sample 134000
Loading sample 127000
Loading sample 218000
Loading sample 162000
Loading sample 84000
Loading sample 94000
Loading sample 56000
Loading sample 98000
Loading sample 196000
Loading sample 109000
Loading sample 110000
Loading sample 265000
Loading sample 52000
Loading sample 204000
Loading sample 57000
Loading sample 110000
Loading sample 225000
Loading sample 263000
Loading sample 261000
Loading sample 174000
Loading sample 239000
Loading sample 99000
Loading sample 37000
Loading sample 285000
Loading sample 199000
Loading sample 12000
Loading sample 197000
Loading sample 87000
Loading sample 251000
Loading sample 116000
Loading sample 155000
Loading sample 212000
Loading sample 84000
Loading sample 256000
Loading sample 37000
Loading sample 37000
Loading sample 45000
Loading sample 177000
Loading sample 75000
Loading sample 138000
Loading sample 210000
Loading sample 37000
Loading sample 230000
Loading sample 105000
Loading sample 213000
Loading sample 225000
Loading sample 185000
Loading sample 22000
Loading sample 10000
Loading sample 20000
Loading sample 277000
Loading sample 161000
Loading sample 213000
Loading sample 260000
Loading sample 152000
Loading sample 136000
Loading sample 126000
Loading sample 51000
Loading sample 45000
Loading sample 93000
Loading sample 154000
Loading sample 285000
Loading sample 246000
Loading sample 58000
Loading sample 211000
Loading sample 224000
Loading sample 16000
Loading sample 152000
Loading sample 266000
Loading sample 234000
Loading sample 98000
Loading sample 119000
Loading sample 243000
Loading sample 26000
Loading sample 116000
Loading sample 115000
Loading sample 185000
Loading sample 275000
Loading sample 17000
Loading sample 36000
Loading sample 141000
Loading sample 82000
Loading sample 204000
Loading sample 45000
Loading sample 73000
Loading sample 58000
Loading sample 17000
Loading sample 177000
Loading sample 201000
Loading sample 237000
Loading sample 226000
Loading sample 143000
Loading sample 11000
Loading sample 279000
Loading sample 214000
Loading sample 81000
Loading sample 106000
Loading sample 196000
Loading sample 251000
Loading sample 176000
Loading sample 189000
Loading sample 117000
Loading sample 87000
Loading sample 174000
Loading sample 197000
Loading sample 128000
Loading sample 3000
Loading sample 165000
Loading sample 263000
Loading sample 85000
Loading sample 71000
Loading sample 88000
Loading sample 83000
Loading sample 162000
Loading sample 250000
Loading sample 195000
Loading sample 189000
Loading sample 204000
Loading sample 61000
Loading sample 4000
Loading sample 103000
Loading sample 216000
Loading sample 57000
Loading sample 48000
Loading sample 248000
Loading sample 93000
Loading sample 70000
Loading sample 11000
Loading sample 56000
Loading sample 36000
Loading sample 16000
Loading sample 72000
Loading sample 155000
Loading sample 152000
Loading sample 55000
Loading sample 250000
Loading sample 230000
Loading sample 191000
Loading sample 220000
Loading sample 59000
Loading sample 102000
Loading sample 45000
Loading sample 113000
Loading sample 130000
Loading sample 67000
Loading sample 29000
Loading sample 171000
Loading sample 178000
Loading sample 103000
Loading sample 37000
Loading sample 48000
Loading sample 19000
Loading sample 257000
Loading sample 58000
Loading sample 110000
Loading sample 58000
Loading sample 42000
Loading sample 245000
Loading sample 21000
Loading sample 238000
Loading sample 27000
Loading sample 246000
Loading sample 73000
Loading sample 97000
Loading sample 267000
Loading sample 15000
Loading sample 18000
Loading sample 91000
Loading sample 103000
Loading sample 178000
Loading sample 268000
Loading sample 194000
Loading sample 46000
Loading sample 54000
Loading sample 47000
Loading sample 163000
Loading sample 202000
Loading sample 144000
Loading sample 195000
Loading sample 241000
Loading sample 56000
Loading sample 74000
Loading sample 34000
Loading sample 182000
Loading sample 57000
Loading sample 212000
Loading sample 75000
Loading sample 224000
Loading sample 94000
Loading sample 98000
Loading sample 66000
Loading sample 12000
Loading sample 10000
Loading sample 34000
Loading sample 120000
Loading sample 48000
Loading sample 169000
Loading sample 156000
Loading sample 152000
Loading sample 122000
Loading sample 243000
Loading sample 52000
Loading sample 158000
Loading sample 41000
Loading sample 31000
Loading sample 258000
Loading sample 62000
Loading sample 3000
Loading sample 197000
Loading sample 227000
Loading sample 257000
Loading sample 10000
Loading sample 257000
Loading sample 249000
Loading sample 179000
Loading sample 74000
Loading sample 174000
Loading sample 132000
Loading sample 70000
Loading sample 219000
Loading sample 173000
Loading sample 257000
Loading sample 191000
Loading sample 157000
Loading sample 117000
Loading sample 241000
Loading sample 136000
Loading sample 108000
Loading sample 169000
Loading sample 176000
Loading sample 105000
Loading sample 120000
Loading sample 136000
Loading sample 92000
Loading sample 79000
Loading sample 159000
Loading sample 121000
Loading sample 36000
Loading sample 57000
Loading sample 129000
Loading sample 86000
Loading sample 138000
Loading sample 264000
Loading sample 39000
Loading sample 96000
Loading sample 45000
Loading sample 163000
Loading sample 243000
Loading sample 185000
Loading sample 41000
Loading sample 127000
Loading sample 123000
Loading sample 68000
Loading sample 62000
Loading sample 55000
Loading sample 278000
Loading sample 268000
Loading sample 177000
Loading sample 258000
Loading sample 230000
Loading sample 89000
Loading sample 261000
Loading sample 278000
Loading sample 16000
Loading sample 110000
Loading sample 257000
Loading sample 44000
Loading sample 110000
Loading sample 177000
Loading sample 166000
Loading sample 144000
Loading sample 48000
Loading sample 140000
Loading sample 273000
Loading sample 267000
Loading sample 2000
Loading sample 54000
Loading sample 185000
Loading sample 261000
Loading sample 71000
Loading sample 113000
Loading sample 23000
Loading sample 219000
Loading sample 29000
Loading sample 201000
Loading sample 86000
Loading sample 64000
Loading sample 75000
Loading sample 261000
Loading sample 176000
Loading sample 274000
Loading sample 56000
Loading sample 47000
Loading sample 149000
Loading sample 264000
Loading sample 102000
Loading sample 79000
Loading sample 35000
Loading sample 101000
Loading sample 57000
Loading sample 138000
Loading sample 234000
Loading sample 186000
Loading sample 84000
Loading sample 86000
Loading sample 8000
Loading sample 34000
Loading sample 225000
Loading sample 208000
Loading sample 67000
Loading sample 25000
Loading sample 60000
Loading sample 35000
Loading sample 54000
Loading sample 121000
Loading sample 200000
Loading sample 241000
Loading sample 170000
Loading sample 196000
Loading sample 40000
Loading sample 220000
Loading sample 241000
Loading sample 255000
Loading sample 195000
Loading sample 10000
Loading sample 68000
Loading sample 65000
Loading sample 47000
Loading sample 115000
Loading sample 236000
Loading sample 246000
Loading sample 171000
Loading sample 158000
Loading sample 95000
Loading sample 64000
Loading sample 41000
Loading sample 76000
Loading sample 50000
Loading sample 39000
Loading sample 99000
Loading sample 100000
Loading sample 142000
Loading sample 192000
Loading sample 273000
Loading sample 48000
Loading sample 136000
Loading sample 274000
Loading sample 92000
Loading sample 259000
Loading sample 212000
Loading sample 166000
Loading sample 182000
Loading sample 195000
Loading sample 133000
Loading sample 135000
Loading sample 94000
Loading sample 85000
Loading sample 251000
Loading sample 11000
Loading sample 88000
Loading sample 188000
Loading sample 61000
Loading sample 19000
Loading sample 204000
Loading sample 267000
Loading sample 200000
Loading sample 110000
Loading sample 257000
Loading sample 75000
Loading sample 252000
Loading sample 192000
Loading sample 106000
Loading sample 146000
Loading sample 171000
Loading sample 143000
Loading sample 154000
Loading sample 54000
Loading sample 200000
Loading sample 198000
Loading sample 33000
Loading sample 87000
Loading sample 168000
Loading sample 278000
Loading sample 129000
Loading sample 77000
Loading sample 8000
Loading sample 206000
Loading sample 90000
Loading sample 144000
Loading sample 183000
Loading sample 15000
Loading sample 14000
Loading sample 166000
Loading sample 133000
Loading sample 210000
Loading sample 223000
Loading sample 257000
Loading sample 12000
Loading sample 237000
Loading sample 266000
Loading sample 233000
Loading sample 209000
Loading sample 204000
Loading sample 174000
Loading sample 37000
Loading sample 219000
Loading sample 130000
Loading sample 55000
Loading sample 115000
Loading sample 64000
Loading sample 225000
Loading sample 108000
Loading sample 284000
Loading sample 144000
Loading sample 54000
Loading sample 211000
Loading sample 228000
Loading sample 136000
Loading sample 24000
Loading sample 274000
Loading sample 277000
Loading sample 39000
Loading sample 88000
Loading sample 176000
Loading sample 209000
Loading sample 136000
Loading sample 87000
Loading sample 285000
Loading sample 119000
Loading sample 250000
Loading sample 260000
Loading sample 229000
Loading sample 156000
Loading sample 195000
Loading sample 179000
Loading sample 219000
Loading sample 44000
Loading sample 158000
Loading sample 184000
Loading sample 12000
Loading sample 2000
Loading sample 142000
Loading sample 161000
Loading sample 22000
Loading sample 41000
Loading sample 152000
Loading sample 124000
Loading sample 174000
Loading sample 26000
Loading sample 242000
Loading sample 213000
Loading sample 137000
Loading sample 260000
Loading sample 217000
Loading sample 31000
Loading sample 83000
Loading sample 103000
Loading sample 258000
Loading sample 32000
Loading sample 185000
Loading sample 53000
Loading sample 263000
Loading sample 141000
Loading sample 126000
Loading sample 166000
Loading sample 218000
Loading sample 83000
Loading sample 230000
Loading sample 235000
Loading sample 17000
Loading sample 86000
Loading sample 42000
Loading sample 105000
Loading sample 232000
Loading sample 23000
Loading sample 102000
Loading sample 183000
Loading sample 46000
Loading sample 106000
Loading sample 3000
Loading sample 134000
Loading sample 63000
Loading sample 134000
Loading sample 156000
Loading sample 76000
Loading sample 194000
Loading sample 88000
Loading sample 153000
Loading sample 149000
Loading sample 155000
Loading sample 269000
Loading sample 100000
Loading sample 33000
Loading sample 31000
Loading sample 5000
Loading sample 109000
Loading sample 273000
Loading sample 3000
Loading sample 223000
Loading sample 71000
Loading sample 231000
Loading sample 234000
Loading sample 207000
Loading sample 90000
Loading sample 42000
Loading sample 194000
Loading sample 116000
Loading sample 170000
Loading sample 122000
Loading sample 166000
Loading sample 219000
Loading sample 22000
Loading sample 227000
Loading sample 45000
Loading sample 141000
Received signal 15. Cleaning up...
Performing cleanup...
Performing cleanup...
Warning: Error during cleanup: name '_model' is not defined
Performing cleanup...
Warning: Error during cleanup: name '_model' is not defined
|