sklearn -- Transformer and estimator

sklearn -- Transformer and estimator Among the sklearn I contacted before, there are SimpleImputer, OrdinalEncoder and OneHotEncoder. What they have in common is that they are all used for data feature preprocessing. In the use of them, it is inevitable to encounter: fit_transform,transform. At first, I didn't fully understand it, but I ...

Posted on Thu, 28 Oct 2021 20:53:02 -0400 by bulldorc

[NLP] Transformer architecture analysis

1. Understand Transformer architecture 1.1 role of transformer model The transformer model based on seq2seq architecture can complete typical tasks in NLP field, such as machine translation, text generation, etc. at the same time, it can also build a pre training language model for transfer learning of different tasks Statement: In the ...

Posted on Sun, 24 Oct 2021 05:15:44 -0400 by maciek4

Start a classification task using swing transformer in MMClassification

Recently, Swin Transformer became the best paper of ICCV2021. As a basic model, it has achieved SOTA results in downstream tasks such as classification, detection and segmentation. MMClassification(MMCls) is an open source image classification toolbox and a member of the open source algorithm library of OpenMMLab. This article mainly introduces ...

Posted on Tue, 19 Oct 2021 22:08:38 -0400 by weekender

Natural language processing NLP star sky intelligent dialogue robot series: in depth understanding of Transformer natural language processing summarizing documents with T5 large

Natural language processing NLP star sky intelligent dialogue robot series: in depth understanding of Transformer natural language processing summarizing documents with T5 large Summarizing documents with T5-large We will create a summary function that can be called with any text. We will summarize the text with legal and financial exampl ...

Posted on Thu, 14 Oct 2021 18:05:19 -0400 by Viruthagiri

Swing transformer classification source code (has run through collab)

The following is the blog for reference in this article. You can refer to it if you need it: 1,Swing transformer segmentation source code (passed) 2,Swing transformer classification source code (passed) 3,Understanding points of swin transformer 1, Summary In the recent swin transformer fire, the code has been open source, and girhub has s ...

Posted on Wed, 06 Oct 2021 20:30:29 -0400 by gterre

NLP star sky intelligent dialogue robot series for natural language processing: in depth understanding of Transformer Workshop on Machine Translation (WMT)

NLP star sky intelligent dialogue robot series for natural language processing: in depth understanding of Transformer Workshop on Machine Translation (WMT) Machine transductions and translations The evaluation of machine translation shows the progress of natural language processing technology. To determine that one solution is better than ...

Posted on Mon, 27 Sep 2021 07:20:09 -0400 by Kor Ikron

NLP star sky intelligent dialogue robot series for natural language processing: in depth understanding of Transformer natural language processing KantaiBERT ByteLevelBPETokenizer

NLP star sky intelligent dialogue robot series for natural language processing: in depth understanding of Transformer natural language processing KantaiBERT ByteLevelBPETokenizer Step 3: Training a tokenizer This paper does not use the pre-trained marker, such as the pre-trained GPT-2 marker, but trains the marker from scratch. Hugging Fa ...

Posted on Mon, 20 Sep 2021 06:24:19 -0400 by Klojum