-
Notifications
You must be signed in to change notification settings - Fork 0
/
model_behaviour
657 lines (618 loc) · 36.7 KB
/
model_behaviour
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
epochs=50, dropout after flatten and 0.2, validation_split=0.2
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_1 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 192 samples, validate on 48 samples
Epoch 1/50
192/192 [==============================] - 2s 9ms/step - loss: 0.6916 - acc: 0.5938 - val_loss: 3.5234 - val_acc: 0.5000
Epoch 2/50
192/192 [==============================] - 1s 6ms/step - loss: 0.4926 - acc: 0.8021 - val_loss: 6.3425 - val_acc: 0.4583
Epoch 3/50
192/192 [==============================] - 1s 6ms/step - loss: 0.3648 - acc: 0.9740 - val_loss: 6.5935 - val_acc: 0.4583
Epoch 4/50
192/192 [==============================] - 1s 6ms/step - loss: 0.3033 - acc: 0.9167 - val_loss: 6.6666 - val_acc: 0.4583
240/240 [==============================] - 0s 809us/step
Accuracy: 66.666667
Model saved to disk.
Epochs=20, dropout after enbedding and 0.2, validation_split=0.2
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 232 samples, validate on 58 samples
Epoch 1/20
232/232 [==============================] - 2s 8ms/step - loss: 1.1406 - acc: 0.5603 - val_loss: 1.0231 - val_acc: 0.2931
Epoch 2/20
232/232 [==============================] - 2s 7ms/step - loss: 0.7434 - acc: 0.8491 - val_loss: 0.8724 - val_acc: 0.7414
Epoch 3/20
232/232 [==============================] - 2s 7ms/step - loss: 0.5262 - acc: 0.9267 - val_loss: 1.2187 - val_acc: 0.2759
Epoch 4/20
232/232 [==============================] - 2s 7ms/step - loss: 0.3989 - acc: 0.8879 - val_loss: 1.1837 - val_acc: 0.3621
Epoch 5/20
232/232 [==============================] - 2s 7ms/step - loss: 0.3420 - acc: 0.9741 - val_loss: 1.0771 - val_acc: 0.5345
290/290 [==============================] - 0s 737us/step
Accuracy: 85.517241
Model saved to disk.
Dropout after flatten and 0.4, epochs=20, validation_split=0.2
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 232 samples, validate on 58 samples
Epoch 1/20
232/232 [==============================] - 2s 8ms/step - loss: 0.6940 - acc: 0.7328 - val_loss: 0.7493 - val_acc: 0.4310
Epoch 2/20
232/232 [==============================] - 2s 7ms/step - loss: 0.4869 - acc: 0.8276 - val_loss: 1.2869 - val_acc: 0.3448
Epoch 3/20
232/232 [==============================] - 2s 7ms/step - loss: 0.3769 - acc: 0.8793 - val_loss: 1.5706 - val_acc: 0.3621
Epoch 4/20
232/232 [==============================] - 2s 7ms/step - loss: 0.2878 - acc: 0.9267 - val_loss: 1.5618 - val_acc: 0.3103
290/290 [==============================] - 0s 766us/step
Accuracy: 76.896552
Model saved to disk.
No dropout layer, epochs=20, validation_split=0.2
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 232 samples, validate on 58 samples
Epoch 1/20
232/232 [==============================] - 2s 8ms/step - loss: 0.2522 - acc: 0.9310 - val_loss: 1.5259 - val_acc: 0.3103
Epoch 2/20
232/232 [==============================] - 2s 7ms/step - loss: 0.2216 - acc: 0.9698 - val_loss: 1.4650 - val_acc: 0.3793
Epoch 3/20
232/232 [==============================] - 2s 7ms/step - loss: 0.2016 - acc: 0.9784 - val_loss: 1.4436 - val_acc: 0.4310
Epoch 4/20
232/232 [==============================] - 2s 7ms/step - loss: 0.1789 - acc: 0.9784 - val_loss: 1.4529 - val_acc: 0.4138
Epoch 5/20
232/232 [==============================] - 2s 7ms/step - loss: 0.1612 - acc: 0.9914 - val_loss: 1.4578 - val_acc: 0.3966
Epoch 6/20
232/232 [==============================] - 2s 7ms/step - loss: 0.1532 - acc: 0.9871 - val_loss: 1.4731 - val_acc: 0.3793
290/290 [==============================] - 0s 825us/step
Accuracy: 81.379310
Model saved to disk.
validation_split=0.4, no dropout layer
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 204 samples, validate on 136 samples
Epoch 1/20
204/204 [==============================] - 2s 10ms/step - loss: 0.1558 - acc: 0.9853 - val_loss: 0.8706 - val_acc: 0.6176
Epoch 2/20
204/204 [==============================] - 1s 7ms/step - loss: 0.1458 - acc: 0.9902 - val_loss: 0.8709 - val_acc: 0.6324
Epoch 3/20
204/204 [==============================] - 2s 7ms/step - loss: 0.1342 - acc: 1.0000 - val_loss: 0.8755 - val_acc: 0.6324
Epoch 4/20
204/204 [==============================] - 1s 7ms/step - loss: 0.1247 - acc: 1.0000 - val_loss: 0.8811 - val_acc: 0.6324
290/290 [==============================] - 0s 833us/step
Accuracy: 82.758621
Model saved to disk.
dropout=0.2 after flatten, validation_split=0.4
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_1 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 204 samples, validate on 136 samples
Epoch 1/20
204/204 [==============================] - 2s 8ms/step - loss: 1.0204 - acc: 0.5784 - val_loss: 2.1191 - val_acc: 0.4338
Epoch 2/20
204/204 [==============================] - 1s 7ms/step - loss: 0.7928 - acc: 0.8480 - val_loss: 2.6546 - val_acc: 0.5147
Epoch 3/20
204/204 [==============================] - 1s 7ms/step - loss: 0.6619 - acc: 0.9020 - val_loss: 2.8267 - val_acc: 0.4779
Epoch 4/20
204/204 [==============================] - 1s 7ms/step - loss: 0.5765 - acc: 0.9510 - val_loss: 2.7922 - val_acc: 0.5441
290/290 [==============================] - 0s 747us/step
Accuracy: 77.241379
Model saved to disk.
epochs=10, dropout=0.2 2 layers, validation_split=0.4
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_2 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 204 samples, validate on 136 samples
Epoch 1/10
204/204 [==============================] - 3s 13ms/step - loss: 0.9049 - acc: 0.6078 - val_loss: 1.1489 - val_acc: 0.5221
Epoch 2/10
204/204 [==============================] - 2s 12ms/step - loss: 0.7041 - acc: 0.8480 - val_loss: 2.2517 - val_acc: 0.6176
Epoch 3/10
204/204 [==============================] - 2s 12ms/step - loss: 0.6930 - acc: 0.9265 - val_loss: 2.8734 - val_acc: 0.4559
Epoch 4/10
204/204 [==============================] - 2s 12ms/step - loss: 0.6128 - acc: 0.8824 - val_loss: 2.8626 - val_acc: 0.4779
290/290 [==============================] - 0s 730us/step
Accuracy: 73.448276
Model saved to disk.
validation_data=50, removed callback early stopping, droput=0.2 2 layers
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_2 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 290 samples, validate on 290 samples
Epoch 1/10
290/290 [==============================] - 4s 14ms/step - loss: 1.4201 - acc: 0.5414 - val_loss: 1.0877 - val_acc: 0.7172
Epoch 2/10
290/290 [==============================] - 4s 12ms/step - loss: 1.1029 - acc: 0.7793 - val_loss: 1.0096 - val_acc: 0.8034
Epoch 3/10
290/290 [==============================] - 4s 12ms/step - loss: 0.9621 - acc: 0.8690 - val_loss: 0.8923 - val_acc: 0.8690
Epoch 4/10
290/290 [==============================] - 4s 12ms/step - loss: 0.8391 - acc: 0.9241 - val_loss: 0.8572 - val_acc: 0.8793
Epoch 5/10
290/290 [==============================] - 4s 12ms/step - loss: 0.8081 - acc: 0.9172 - val_loss: 0.8255 - val_acc: 0.9172
Epoch 6/10
290/290 [==============================] - 4s 12ms/step - loss: 0.7754 - acc: 0.9448 - val_loss: 0.8081 - val_acc: 0.8931
Epoch 7/10
290/290 [==============================] - 4s 12ms/step - loss: 0.7461 - acc: 0.9552 - val_loss: 0.7852 - val_acc: 0.9207
Epoch 8/10
290/290 [==============================] - 4s 12ms/step - loss: 0.7282 - acc: 0.9483 - val_loss: 0.7707 - val_acc: 0.9310
Epoch 9/10
290/290 [==============================] - 4s 12ms/step - loss: 0.7099 - acc: 0.9621 - val_loss: 0.7592 - val_acc: 0.9172
Epoch 10/10
290/290 [==============================] - 4s 13ms/step - loss: 0.7050 - acc: 0.9517 - val_loss: 0.7693 - val_acc: 0.8793
Accuracy: 87.931034
Loss: 0.7693329358923024
Model saved to disk.
epochs=20, validation_data=50, removed callback early stopping, droput=0.2 2 layers
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_2 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 290 samples, validate on 290 samples
Epoch 1/20
290/290 [==============================] - 4s 13ms/step - loss: 1.1207 - acc: 0.5207 - val_loss: 0.8139 - val_acc: 0.7931
Epoch 2/20
290/290 [==============================] - 4s 12ms/step - loss: 0.7506 - acc: 0.7690 - val_loss: 0.7042 - val_acc: 0.8724
Epoch 3/20
290/290 [==============================] - 4s 12ms/step - loss: 0.6412 - acc: 0.8862 - val_loss: 0.6154 - val_acc: 0.8931
Epoch 4/20
290/290 [==============================] - 4s 12ms/step - loss: 0.5762 - acc: 0.9207 - val_loss: 0.5734 - val_acc: 0.9241
Epoch 5/20
290/290 [==============================] - 4s 12ms/step - loss: 0.5140 - acc: 0.9483 - val_loss: 0.5608 - val_acc: 0.9000
Epoch 6/20
290/290 [==============================] - 4s 13ms/step - loss: 0.4902 - acc: 0.9517 - val_loss: 0.5280 - val_acc: 0.9345
Epoch 7/20
290/290 [==============================] - 4s 12ms/step - loss: 0.4692 - acc: 0.9724 - val_loss: 0.5106 - val_acc: 0.9345
Epoch 8/20
290/290 [==============================] - 4s 12ms/step - loss: 0.4537 - acc: 0.9793 - val_loss: 0.4945 - val_acc: 0.9414
Epoch 9/20
290/290 [==============================] - 4s 12ms/step - loss: 0.4350 - acc: 0.9759 - val_loss: 0.4795 - val_acc: 0.9448
Epoch 10/20
290/290 [==============================] - 4s 12ms/step - loss: 0.4130 - acc: 0.9828 - val_loss: 0.4787 - val_acc: 0.9310
Epoch 11/20
290/290 [==============================] - 4s 12ms/step - loss: 0.4057 - acc: 0.9759 - val_loss: 0.4660 - val_acc: 0.9379
Epoch 12/20
290/290 [==============================] - 4s 12ms/step - loss: 0.3925 - acc: 0.9828 - val_loss: 0.4530 - val_acc: 0.9448
Epoch 13/20
290/290 [==============================] - 4s 12ms/step - loss: 0.3801 - acc: 0.9828 - val_loss: 0.4552 - val_acc: 0.9310
Epoch 14/20
290/290 [==============================] - 4s 12ms/step - loss: 0.3766 - acc: 0.9793 - val_loss: 0.4401 - val_acc: 0.9448
Epoch 15/20
290/290 [==============================] - 4s 12ms/step - loss: 0.3669 - acc: 0.9828 - val_loss: 0.4368 - val_acc: 0.9448
Epoch 16/20
290/290 [==============================] - 4s 12ms/step - loss: 0.3607 - acc: 0.9828 - val_loss: 0.4346 - val_acc: 0.9345
Epoch 17/20
290/290 [==============================] - 4s 12ms/step - loss: 0.3510 - acc: 0.9828 - val_loss: 0.4308 - val_acc: 0.9345
Epoch 18/20
290/290 [==============================] - 3s 12ms/step - loss: 0.3507 - acc: 0.9828 - val_loss: 0.4250 - val_acc: 0.9448
Epoch 19/20
290/290 [==============================] - 4s 13ms/step - loss: 0.3460 - acc: 0.9828 - val_loss: 0.4269 - val_acc: 0.9345
Epoch 20/20
290/290 [==============================] - 4s 12ms/step - loss: 0.3392 - acc: 0.9828 - val_loss: 0.4215 - val_acc: 0.9345
Accuracy: 93.448276
Loss: 0.4214938768025102
Model saved to disk.
epochs=30, validation_data=50, removed callback early stopping, droput=0.2 2 layers
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_2 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 290 samples, validate on 290 samples
Epoch 1/30
290/290 [==============================] - 4s 13ms/step - loss: 1.2209 - acc: 0.5345 - val_loss: 0.5685 - val_acc: 0.8517
Epoch 2/30
290/290 [==============================] - 4s 12ms/step - loss: 0.7802 - acc: 0.7310 - val_loss: 0.7381 - val_acc: 0.8414
Epoch 3/30
290/290 [==============================] - 4s 12ms/step - loss: 0.5888 - acc: 0.8276 - val_loss: 0.4739 - val_acc: 0.7690
Epoch 4/30
290/290 [==============================] - 3s 12ms/step - loss: 0.3984 - acc: 0.9207 - val_loss: 0.4033 - val_acc: 0.9069
Epoch 5/30
290/290 [==============================] - 4s 12ms/step - loss: 0.3560 - acc: 0.9621 - val_loss: 0.3695 - val_acc: 0.9172
Epoch 6/30
290/290 [==============================] - 4s 12ms/step - loss: 0.3249 - acc: 0.9276 - val_loss: 0.3533 - val_acc: 0.9138
Epoch 7/30
290/290 [==============================] - 4s 12ms/step - loss: 0.2873 - acc: 0.9690 - val_loss: 0.3256 - val_acc: 0.9345
Epoch 8/30
290/290 [==============================] - 4s 12ms/step - loss: 0.2654 - acc: 0.9621 - val_loss: 0.3111 - val_acc: 0.9310
Epoch 9/30
290/290 [==============================] - 4s 12ms/step - loss: 0.2435 - acc: 0.9828 - val_loss: 0.2936 - val_acc: 0.9414
Epoch 10/30
290/290 [==============================] - 4s 12ms/step - loss: 0.2299 - acc: 0.9931 - val_loss: 0.2824 - val_acc: 0.9414
Epoch 11/30
290/290 [==============================] - 4s 12ms/step - loss: 0.2150 - acc: 0.9897 - val_loss: 0.2730 - val_acc: 0.9379
Epoch 12/30
290/290 [==============================] - 4s 12ms/step - loss: 0.2031 - acc: 0.9793 - val_loss: 0.2610 - val_acc: 0.9552
Epoch 13/30
290/290 [==============================] - 4s 12ms/step - loss: 0.2002 - acc: 0.9897 - val_loss: 0.2556 - val_acc: 0.9414
Epoch 14/30
290/290 [==============================] - 4s 13ms/step - loss: 0.1844 - acc: 0.9966 - val_loss: 0.2522 - val_acc: 0.9379
Epoch 15/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1764 - acc: 0.9966 - val_loss: 0.2399 - val_acc: 0.9448
Epoch 16/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1658 - acc: 0.9931 - val_loss: 0.2341 - val_acc: 0.9448
Epoch 17/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1560 - acc: 0.9966 - val_loss: 0.2296 - val_acc: 0.9448
Epoch 18/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1518 - acc: 0.9966 - val_loss: 0.2266 - val_acc: 0.9448
Epoch 19/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1418 - acc: 0.9966 - val_loss: 0.2194 - val_acc: 0.9483
Epoch 20/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1407 - acc: 0.9966 - val_loss: 0.2145 - val_acc: 0.9517
Epoch 21/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1338 - acc: 0.9966 - val_loss: 0.2104 - val_acc: 0.9517
Epoch 22/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1286 - acc: 0.9966 - val_loss: 0.2085 - val_acc: 0.9517
Epoch 23/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1257 - acc: 0.9966 - val_loss: 0.2159 - val_acc: 0.9379
Epoch 24/30
290/290 [==============================] - 3s 12ms/step - loss: 0.1252 - acc: 0.9966 - val_loss: 0.2050 - val_acc: 0.9483
Epoch 25/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1199 - acc: 0.9966 - val_loss: 0.1996 - val_acc: 0.9517
Epoch 26/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1183 - acc: 0.9966 - val_loss: 0.1986 - val_acc: 0.9552
Epoch 27/30
290/290 [==============================] - 4s 13ms/step - loss: 0.1125 - acc: 0.9966 - val_loss: 0.2001 - val_acc: 0.9448
Epoch 28/30
290/290 [==============================] - 3s 12ms/step - loss: 0.1109 - acc: 0.9966 - val_loss: 0.1957 - val_acc: 0.9552
Epoch 29/30
290/290 [==============================] - 4s 12ms/step - loss: 0.1080 - acc: 0.9966 - val_loss: 0.1941 - val_acc: 0.9517
Epoch 30/30
290/290 [==============================] - 3s 12ms/step - loss: 0.1048 - acc: 0.9966 - val_loss: 0.1930 - val_acc: 0.9517
Accuracy: 95.172414
Loss: 0.19302918025902632
Model saved to disk.
epochs=40, validation_data=50, removed callback early stopping, droput=0.2 2 layers
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_2 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 290 samples, validate on 290 samples
Epoch 1/40
290/290 [==============================] - 4s 13ms/step - loss: 0.8730 - acc: 0.5759 - val_loss: 0.9379 - val_acc: 0.6828
Epoch 2/40
290/290 [==============================] - 4s 12ms/step - loss: 0.7749 - acc: 0.7690 - val_loss: 0.4888 - val_acc: 0.6828
Epoch 3/40
290/290 [==============================] - 4s 12ms/step - loss: 0.4494 - acc: 0.8379 - val_loss: 0.3394 - val_acc: 0.8931
Epoch 4/40
290/290 [==============================] - 4s 12ms/step - loss: 0.3051 - acc: 0.9103 - val_loss: 0.3052 - val_acc: 0.9103
Epoch 5/40
290/290 [==============================] - 4s 12ms/step - loss: 0.2702 - acc: 0.9345 - val_loss: 0.3050 - val_acc: 0.8862
Epoch 6/40
290/290 [==============================] - 4s 12ms/step - loss: 0.2240 - acc: 0.9690 - val_loss: 0.2573 - val_acc: 0.9310
Epoch 7/40
290/290 [==============================] - 4s 12ms/step - loss: 0.1995 - acc: 0.9793 - val_loss: 0.2459 - val_acc: 0.9345
Epoch 8/40
290/290 [==============================] - 4s 12ms/step - loss: 0.1738 - acc: 0.9931 - val_loss: 0.2330 - val_acc: 0.9345
Epoch 9/40
290/290 [==============================] - 4s 12ms/step - loss: 0.1502 - acc: 0.9897 - val_loss: 0.2131 - val_acc: 0.9448
Epoch 10/40
290/290 [==============================] - 4s 12ms/step - loss: 0.1456 - acc: 0.9828 - val_loss: 0.2006 - val_acc: 0.9586
Epoch 11/40
290/290 [==============================] - 4s 12ms/step - loss: 0.1265 - acc: 1.0000 - val_loss: 0.1987 - val_acc: 0.9379
Epoch 12/40
290/290 [==============================] - 4s 12ms/step - loss: 0.1155 - acc: 1.0000 - val_loss: 0.1843 - val_acc: 0.9517
Epoch 13/40
290/290 [==============================] - 3s 12ms/step - loss: 0.1043 - acc: 1.0000 - val_loss: 0.1824 - val_acc: 0.9379
Epoch 14/40
290/290 [==============================] - 3s 12ms/step - loss: 0.1009 - acc: 0.9931 - val_loss: 0.1683 - val_acc: 0.9621
Epoch 15/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0963 - acc: 1.0000 - val_loss: 0.1626 - val_acc: 0.9621
Epoch 16/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0881 - acc: 1.0000 - val_loss: 0.1752 - val_acc: 0.9310
Epoch 17/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0814 - acc: 1.0000 - val_loss: 0.1588 - val_acc: 0.9414
Epoch 18/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0774 - acc: 1.0000 - val_loss: 0.1503 - val_acc: 0.9621
Epoch 19/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0673 - acc: 1.0000 - val_loss: 0.1496 - val_acc: 0.9448
Epoch 20/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0647 - acc: 1.0000 - val_loss: 0.1442 - val_acc: 0.9621
Epoch 21/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0585 - acc: 1.0000 - val_loss: 0.1435 - val_acc: 0.9552
Epoch 22/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0575 - acc: 1.0000 - val_loss: 0.1447 - val_acc: 0.9414
Epoch 23/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0545 - acc: 1.0000 - val_loss: 0.1381 - val_acc: 0.9621
Epoch 24/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0487 - acc: 1.0000 - val_loss: 0.1354 - val_acc: 0.9621
Epoch 25/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0488 - acc: 1.0000 - val_loss: 0.1353 - val_acc: 0.9552
Epoch 26/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0496 - acc: 1.0000 - val_loss: 0.1382 - val_acc: 0.9448
Epoch 27/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0433 - acc: 1.0000 - val_loss: 0.1327 - val_acc: 0.9552
Epoch 28/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0446 - acc: 1.0000 - val_loss: 0.1305 - val_acc: 0.9586
Epoch 29/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0398 - acc: 1.0000 - val_loss: 0.1360 - val_acc: 0.9448
Epoch 30/40
290/290 [==============================] - 4s 13ms/step - loss: 0.0369 - acc: 1.0000 - val_loss: 0.1353 - val_acc: 0.9448
Epoch 31/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0356 - acc: 1.0000 - val_loss: 0.1294 - val_acc: 0.9483
Epoch 32/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0341 - acc: 1.0000 - val_loss: 0.1271 - val_acc: 0.9552
Epoch 33/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0338 - acc: 1.0000 - val_loss: 0.1263 - val_acc: 0.9552
Epoch 34/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0304 - acc: 1.0000 - val_loss: 0.1265 - val_acc: 0.9483
Epoch 35/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0297 - acc: 1.0000 - val_loss: 0.1267 - val_acc: 0.9483
Epoch 36/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0300 - acc: 1.0000 - val_loss: 0.1247 - val_acc: 0.9586
Epoch 37/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0286 - acc: 1.0000 - val_loss: 0.1323 - val_acc: 0.9448
Epoch 38/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0274 - acc: 1.0000 - val_loss: 0.1268 - val_acc: 0.9483
Epoch 39/40
290/290 [==============================] - 3s 12ms/step - loss: 0.0290 - acc: 1.0000 - val_loss: 0.1249 - val_acc: 0.9483
Epoch 40/40
290/290 [==============================] - 4s 12ms/step - loss: 0.0242 - acc: 1.0000 - val_loss: 0.1238 - val_acc: 0.9483
Accuracy: 94.827586
Loss: 0.12380899251920396
Model saved to disk.
epochs=50
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
embedding_1 (Embedding) (None, 5323, 100) 1518700
_________________________________________________________________
dropout_1 (Dropout) (None, 5323, 100) 0
_________________________________________________________________
flatten_1 (Flatten) (None, 532300) 0
_________________________________________________________________
dropout_2 (Dropout) (None, 532300) 0
_________________________________________________________________
dense_1 (Dense) (None, 1) 532301
=================================================================
Total params: 2,051,001
Trainable params: 532,301
Non-trainable params: 1,518,700
_________________________________________________________________
None
Train on 290 samples, validate on 290 samples
Epoch 1/50
290/290 [==============================] - 4s 13ms/step - loss: 1.1875 - acc: 0.5172 - val_loss: 0.8856 - val_acc: 0.7655
Epoch 2/50
290/290 [==============================] - 3s 12ms/step - loss: 0.8413 - acc: 0.7655 - val_loss: 0.7916 - val_acc: 0.8310
Epoch 3/50
290/290 [==============================] - 4s 12ms/step - loss: 0.7504 - acc: 0.8966 - val_loss: 0.6552 - val_acc: 0.9034
Epoch 4/50
290/290 [==============================] - 4s 12ms/step - loss: 0.6087 - acc: 0.9069 - val_loss: 0.6143 - val_acc: 0.8759
Epoch 5/50
290/290 [==============================] - 3s 12ms/step - loss: 0.5735 - acc: 0.9483 - val_loss: 0.5666 - val_acc: 0.9172
Epoch 6/50
290/290 [==============================] - 3s 12ms/step - loss: 0.5139 - acc: 0.9552 - val_loss: 0.5464 - val_acc: 0.9276
Epoch 7/50
290/290 [==============================] - 4s 12ms/step - loss: 0.4860 - acc: 0.9690 - val_loss: 0.5263 - val_acc: 0.9379
Epoch 8/50
290/290 [==============================] - 4s 12ms/step - loss: 0.4716 - acc: 0.9724 - val_loss: 0.5103 - val_acc: 0.9345
Epoch 9/50
290/290 [==============================] - 4s 12ms/step - loss: 0.4553 - acc: 0.9759 - val_loss: 0.4985 - val_acc: 0.9414
Epoch 10/50
290/290 [==============================] - 3s 12ms/step - loss: 0.4356 - acc: 0.9759 - val_loss: 0.5023 - val_acc: 0.9069
Epoch 11/50
290/290 [==============================] - 3s 12ms/step - loss: 0.4206 - acc: 0.9793 - val_loss: 0.4761 - val_acc: 0.9448
Epoch 12/50
290/290 [==============================] - 4s 12ms/step - loss: 0.4068 - acc: 0.9828 - val_loss: 0.4670 - val_acc: 0.9448
Epoch 13/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3981 - acc: 0.9828 - val_loss: 0.4602 - val_acc: 0.9414
Epoch 14/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3847 - acc: 0.9828 - val_loss: 0.4551 - val_acc: 0.9379
Epoch 15/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3757 - acc: 0.9828 - val_loss: 0.4476 - val_acc: 0.9414
Epoch 16/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3743 - acc: 0.9828 - val_loss: 0.4426 - val_acc: 0.9414
Epoch 17/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3593 - acc: 0.9828 - val_loss: 0.4454 - val_acc: 0.9276
Epoch 18/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3595 - acc: 0.9828 - val_loss: 0.4332 - val_acc: 0.9448
Epoch 19/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3556 - acc: 0.9828 - val_loss: 0.4282 - val_acc: 0.9483
Epoch 20/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3491 - acc: 0.9828 - val_loss: 0.4295 - val_acc: 0.9310
Epoch 21/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3446 - acc: 0.9828 - val_loss: 0.4291 - val_acc: 0.9276
Epoch 22/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3440 - acc: 0.9828 - val_loss: 0.4218 - val_acc: 0.9379
Epoch 23/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3367 - acc: 0.9828 - val_loss: 0.4176 - val_acc: 0.9448
Epoch 24/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3391 - acc: 0.9828 - val_loss: 0.4163 - val_acc: 0.9414
Epoch 25/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3320 - acc: 0.9828 - val_loss: 0.4162 - val_acc: 0.9345
Epoch 26/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3320 - acc: 0.9828 - val_loss: 0.4166 - val_acc: 0.9276
Epoch 27/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3273 - acc: 0.9828 - val_loss: 0.4100 - val_acc: 0.9448
Epoch 28/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3234 - acc: 0.9828 - val_loss: 0.4101 - val_acc: 0.9379
Epoch 29/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3228 - acc: 0.9828 - val_loss: 0.4102 - val_acc: 0.9379
Epoch 30/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3242 - acc: 0.9828 - val_loss: 0.4103 - val_acc: 0.9379
Epoch 31/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3165 - acc: 0.9828 - val_loss: 0.4051 - val_acc: 0.9414
Epoch 32/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3170 - acc: 0.9828 - val_loss: 0.4044 - val_acc: 0.9379
Epoch 33/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3190 - acc: 0.9828 - val_loss: 0.4041 - val_acc: 0.9379
Epoch 34/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3145 - acc: 0.9828 - val_loss: 0.4087 - val_acc: 0.9310
Epoch 35/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3123 - acc: 0.9828 - val_loss: 0.4046 - val_acc: 0.9379
Epoch 36/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3127 - acc: 0.9828 - val_loss: 0.4018 - val_acc: 0.9379
Epoch 37/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3087 - acc: 0.9828 - val_loss: 0.4014 - val_acc: 0.9379
Epoch 38/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3072 - acc: 0.9828 - val_loss: 0.4035 - val_acc: 0.9379
Epoch 39/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3077 - acc: 0.9828 - val_loss: 0.4023 - val_acc: 0.9379
Epoch 40/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3050 - acc: 0.9828 - val_loss: 0.3987 - val_acc: 0.9414
Epoch 41/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3074 - acc: 0.9828 - val_loss: 0.4002 - val_acc: 0.9414
Epoch 42/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3054 - acc: 0.9828 - val_loss: 0.3979 - val_acc: 0.9448
Epoch 43/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3032 - acc: 0.9828 - val_loss: 0.3992 - val_acc: 0.9414
Epoch 44/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3009 - acc: 0.9828 - val_loss: 0.3983 - val_acc: 0.9414
Epoch 45/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3038 - acc: 0.9828 - val_loss: 0.3962 - val_acc: 0.9448
Epoch 46/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3006 - acc: 0.9828 - val_loss: 0.3971 - val_acc: 0.9448
Epoch 47/50
290/290 [==============================] - 4s 12ms/step - loss: 0.3020 - acc: 0.9828 - val_loss: 0.3945 - val_acc: 0.9448
Epoch 48/50
290/290 [==============================] - 3s 12ms/step - loss: 0.3002 - acc: 0.9828 - val_loss: 0.3953 - val_acc: 0.9448
Epoch 49/50
290/290 [==============================] - 3s 12ms/step - loss: 0.2998 - acc: 0.9828 - val_loss: 0.3970 - val_acc: 0.9448
Epoch 50/50
290/290 [==============================] - 3s 12ms/step - loss: 0.2987 - acc: 0.9828 - val_loss: 0.3994 - val_acc: 0.9379
Accuracy: 93.793103
Loss: 0.3994182520899279
Model saved to disk.