Documente Academic
Documente Profesional
Documente Cultură
with TensorFlow
https://www.esecurityplanet.com/views/article.php/1501001/Security-Threat-Correlation-The-Next-Battlefield.htm 2
2
What is TensorFlow?
Intro Link to EuroPython
CASSANDRA System
made
Stochastic or Distance-based
(SVM, matching, VSIM, k-
NN,CR, PageRank,Kmeans)
Features used
Structures exploited
http://playground.tensorflow.org_maXbox1
http://playground.tensorflow.org_maXbox2
4
https://www.springboard.com/blog/data-mining-python-tutorial/
4
MNIST Classify Task
5
https://datascienceplus.com/mnist-for-machine-learning-beginners-with-softmax-regression/
https://www.springboard.com/blog/data-mining-python-tutorial/ 5
MNIST Confusion Matrix
6
from keras.datasets import mnist
0 1 2 3 4
5 6 7 8 9
CASSANDRA System
2. Main: C:\maXbox\mX46210\DataScience\plot_confusion_matrix_vectormachine.py
3. Second C:\maXbox\mX46210\DataScience\confusionlist\mnist_softmax21.py
https://github.com/aymericdamien/TensorFlow-Examples/blob/master/notebooks/4_Utils/tensorboard_basic.ipynb
There are 60,000 training images and 10,000 test images, all of
which are 28 pixels by 28 pixels.
76 english, 38 content="voa,
36 美国之音 " 74 special hand written
44 Modified National Institute of Standards and
Technology database)
36 голос 36 америки
7
QT from keras import backend as K
@ex.automain
def define_and_train(batch_size, epochs,
convolution_layers, maxpooling_pool_size, maxpooling_dropout,
dense_layers, dense_dropout, final_dropout,_run):
from keras.models import Sequential #convolution
CASSANDRA System
from keras.layers import Dense, Dropout, Flatten, Conv2D,
from keras.utils import to_categorical
from keras.losses import categorical_crossentropy
from keras.optimizers import Adadelta
from keras import backend as K
from keras.callbacks import ModelCheckpoint, Callback
4. C:\maXbox\mX46210\ntwdblib.dll\UnsharpDetector-master\UnsharpDetector-master\inference_gui.py
8
MongoDB/Sacred module import class
0 1 2 3 4
5 6 7 8 9
CASSANDRA System
from sacred import Experiment
from sacred.observers import MongoObserver
from sacred.utils import apply_backspaces_and_linefeeds
import pymongo, pickle, os
import pydot as pdot
import numpy as np
import tensorflow as tf
5. C:\maXbox\mX46210\DataScience\confusionlist\train_convnet_tf.py
9
MongoDB
Start the shell process mongod from
Call from script or start mongod: C:\Program
Files\MongoDB\Server\3.6\bin>mongod
CASSANDRA System
10
MongoDB My Cluster sacred.runs & completed
CASSANDRA System
11
MNIST Sacred Training & Test
12
12
Task Manager
13
13
Task II
14
14
Task III
15
https://pythonexample.com/search/mnist%20tensorboard%20demo/8 15
What's behind test ? (backend pattern, crossentropy)
60000/60000 [==============================] - 426s 7ms/step - loss: 0.4982 - acc: 0.8510 -
val_loss: 0.0788 - val_acc: 0.9749
Using TensorFlow backend.
INFO - MNIST-Convnet4 - Result: 0.9749
INFO - MNIST-Convnet4 - Completed after 0:07:27
Test loss: 0.0788029053777
Test accuracy: 0.9749
59392/60000 [============================>.] - ETA: 5s - loss: 0.0571 - acc: 0.9829
59520/60000 [============================>.] - ETA: 3s - loss: 0.0572 - acc: 0.9829
59648/60000 [============================>.] - ETA: 2s - loss: 0.0572 - acc: 0.9829
59776/60000 [============================>.] - ETA: 1s - loss: 0.0572 - acc: 0.9829
59904/60000 [============================>.] - ETA: 0s - loss: 0.0573 - acc: 0.9829
60000/60000 [==============================] - 513s 9ms/step - loss: 0.0573 - acc:
0.9829 - val_loss: 0.0312 - val_acc: 0.9891
Using TensorFlow backend.
INFO - MNIST-Convnet4 - Result: 0.9891
INFO - MNIST-Convnet4 - Completed after 0:33:28
Test loss: 0.0311644290059 16
Test accuracy: 0.9891
16
What's behind code ? (keras, pymongo, pydot, graphviz)
db = pymongo.MongoClient('mongodb://localhost:27017/').sacred
print(tf.__version__)
os.environ["PATH"] += os.pathsep +
'C:/Program Files (x86)/Graphviz2.38/bin/'
ex = Experiment("MNIST-Convnet4")
ex.observers.append(MongoObserver.create())
ex.captured_out_filter = apply_backspaces_and_linefeeds
https://www.programcreek.com/python/example/103267/keras.datasets.mnist.load_data
17
17
Whats behind 64-bit Python: PIP3 Install
pip3 install sacred
Collecting sacred
Downloading
https://files.pythonhosted.org/packages/2d/86/7be3af
a4d4c1c0c76a5de03e5ff779797ab2654e377685255c11c13c0e
a5/sacred-0.7.3-py2.py3-none-any.whl (82kB)
Collecting pymongo
Downloading
https://files.pythonhosted.org/packages/46/39/b9bb7fed3e3a0ea621a1
512a938c105cd996320d7d9894d8239ca9093340/pymongo-3.6.1-cp36-cp36m-
win_amd64.whl (291kB)
100% |¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦¦| 296kB 728kB/s
Installing collected packages: pymongo
Successfully installed pymongo-3.6.1
https://github.com/pinae/Sacred-MNIST/blob/master/train_convnet.py 18
18
Machine Learning Jokes ;-)
https://maxbox4.wordpress.com/
http://www.softwareschule.ch/examples/machinelearning.jpg 19
19
https://www.kaggle.com/ v ( a, j ) v(b, j )
similarity of doc a to doc b = sim(a, b)
word i v ( a, j ' )
j'
2
(b, j ' )
v
j'
2
A'B'
CASSANDRA System
20
SUMMARY & QUESTIONS
21
21
https://maxbox4.wordpress.com/