Tim Blog

Himmel oder Hölle

openshift

OpenShift is an enterprise-level container cloud PaaS platform launched by RedHat.The whole process of development, testing, deployment, operation and maintenance can be carried out on OpenShift, a...

Posted by neverset on April 17, 2021

transformer

tips lightseq lightseq is make inferencing process faster installation pip3 install lightseq usage lightseq can only receive the model file defined by the Protocol Buffer protocol. hf_bart_expor...

Posted by neverset on April 17, 2021

sql skills

tips Filter Condition: HAVING and WHERE 1) find duplication SELECT Email FROM Person GROUP BY Email HAVING COUNT(Email)>1 2) find distinct item in two table (Content and TVProgram) ```SELEC...

Posted by neverset on April 17, 2021

ros2

ros2 still has following gaps to enable real time performance.

Posted by neverset on April 17, 2021

olap

Hive2MySQL The data includes logs, Dblogs, etc., which are connected to the big data platform HDFS through Sqoop batch or Kafka in real time. After the ETL processing is completed on the big data ...

Posted by neverset on April 17, 2021

flink

Flink is an open-source framework for stateful, large-scale, distributed, and fault-tolerant stream processing. Apache Flink allows to ingest massive streaming data (up to several terabytes) from d...

Posted by neverset on April 17, 2021

data governance

Data governance refers to a process that converting scattered data to unified data, from having few or no organizational processes to comprehensive data management, from data chaos to well-organize...

Posted by neverset on April 17, 2021

clickhouse

Posted by neverset on April 17, 2021

tensorboard

hyperparameter optimization hyperparameters include: No. of hidden layers No. of units or nodes in a hidden layer Learning rate Dropout rate Epochs or iterations Optimizers like SGD, A...

Posted by neverset on April 11, 2021

neural network visualization

PlotNeuralNet PlotNeuralNet(https://github.com/HarisIqbal88/PlotNeuralNet) is used to produce public ready neutral network plot. ```#install dependencies sudo apt-get install texlive-latex-base s...

Posted by neverset on April 11, 2021