TGViewer
Channel Public Channel
DataSpoof

DataSpoof

@dataspoof

Learn Data Science

https://dataspoof4081.graphy.com/membership

Artificial Intelligence
Machine Learning
Data Science
Deep learning
Computer vision
NLP
Big data
Subscribers
15.4K
Photos
239
Videos
22
Links
328

Showing posts older than #616 · Back to latest

Older Posts 20 shown
Post #613 10.3K

Forwarded from DataSpoof- Ask your questions

Post #609 11.7K
Post #607 9.17K
Some interview questions related to Data science

1- what is difference between structured data and unstructured data.

2- what is multicollinearity.and how to remove them

3- which algorithms you use to find the most correlated features in the datasets.

4- define entropy

5- what is the workflow of principal component analysis

6- what are the applications of principal component analysis not with respect to dimensionality reduction

7- what is the Convolutional neural network. Explain me its working
Post #604 9.73K
TLA: Twitter Linguistic Analysis - TLA is built using PyTorch, Transformers and several other state of the art machine learning techniques and it aims to expedite and structure the cumbersome process of collecting, labeling, and analyzing data from Twitter for a corpus of languages while providing detailed labeled datasets for all the languages.


$ pip install TLAF


https://github.com/tusharsarkar3/TLA
Post #602
DataSpoof pinned «Feature Scaling is one of the most useful and necessary transformations to perform on a training dataset, since with very few exceptions, ML algorithms do not fit well to datasets with attributes that have very different scales. Let's talk about it 🧵 There…»
Post #601 9.63K
Feature Scaling is one of the most useful and necessary transformations to perform on a training dataset, since with very few exceptions, ML algorithms do not fit well to datasets with attributes that have very different scales.

Let's talk about it 🧵

There are 2 very effective techniques to transform all the attributes of a dataset to the same scale, which are:
▪️ Normalization
▪️ Standardization

The 2 techniques perform the same task, but in different ways. Moreover, each one has its strengths and weaknesses.

Normalization (min-max scaling) is very simple: values are shifted and rescaled to be in the range of 0 and 1.

This is achieved by subtracting each value by the min value and dividing the result by the difference between the max and min value.

In contrast, Standardization first subtracts the mean value (so that the values always have zero mean) and then divides the result by the standard deviation (so that the resulting distribution has unit variance).

More about them:
▪️Standardization doesn't frame the data between the range 0-1, which is undesirable for some algorithms.
▪️Standardization is robust to outliers.
▪️Normalization is sensitive to outliers. A very large value may squash the other values in the range 0.0-0.2.

Both algorithms are implemented in the Scikit-learn Python library and are very easy to use. Check below Google Colab code with a toy example, where you can see how each technique works.

https://colab.research.google.com/drive/1DsvTezhnwfS7bPAeHHHHLHzcZTvjBzLc?usp=sharing

Check below spreadsheet, where you can see another example, step by step, of how to normalize and standardize your data.

https://docs.google.com/spreadsheets/d/14GsqJxrulv2CBW_XyNUGoA-f9l-6iKuZLJMcc2_5tZM/edit?usp=drivesdk

Well, the real benefit of feature scaling is when you want to train a model from a dataset with many features (e.g., m > 10) and these features have very different scales (different orders of magnitude). For NN this preprocessing is key.

Enable gradient descent to converge faster
Google DS - Feature Scaling.ipynb Colaboratory notebook
Post #597 8.18K
All algorithm related to machinelearning and deep learning
Post #596
DataSpoof pinned «Today you can learn from the best people in your field at no cost I especially enjoy books written by practitioners: their books are fun to read, useful, and contain no fluff. Here are 3 great ones you can get for free: FastAI deep learning framework…»
Post #595 8.12K
Today you can learn from the best people in your field at no cost

I especially enjoy books written by practitioners: their books are fun to read, useful, and contain no fluff.

Here are 3 great ones you can get for free:

FastAI deep learning framework by Jeremy Howard
https://github.com/fastai/fastbook

Approaching almost any machine learning problem ebook

Pdf link- https://github.com/abhishekkrthakur/approachingalmost

Bayesian method for hackers
Pdf link
https://github.com/CamDavidsonPilon/Probabilistic-Programming-and-Bayesian-Methods-for-Hackers
GitHub GitHub - fastai/fastbook: The fastai book, published as Jupyter Notebooks The fastai book, published as Jupyter Notebooks. Contribute to fastai/fastbook development by creating an account on GitHub.
Older posts →
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →