TGViewer
Channel Public Channel
DataSpoof

DataSpoof

@dataspoof

Learn Data Science

https://dataspoof4081.graphy.com/membership

Artificial Intelligence
Machine Learning
Data Science
Deep learning
Computer vision
NLP
Big data
Open in Telegram
Subscribers
15.4K
Photos
239
Videos
22
Links
328

Showing posts older than #1063 · Back to latest

Older Posts 18 shown
Post #1062 3.63K
LLM + LSTM = Large Memory Models (LMMs)
Post #1057 4.63K
Many data scientists don't know how to push ML models to production. Here's the recipe 👇

𝗞𝗲𝘆 𝗜𝗻𝗴𝗿𝗲𝗱𝗶𝗲𝗻𝘁𝘀

🔹 𝗧𝗿𝗮𝗶𝗻 / 𝗧𝗲𝘀𝘁 𝗗𝗮𝘁𝗮𝘀𝗲𝘁 - Ensure Test is representative of Online data
🔹 𝗙𝗲𝗮𝘁𝘂𝗿𝗲 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴 𝗣𝗶𝗽𝗲𝗹𝗶𝗻𝗲 - Generate features in real-time
🔹 𝗠𝗼𝗱𝗲𝗹 𝗢𝗯𝗷𝗲𝗰𝘁 - Trained SkLearn or Tensorflow Model
🔹 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗖𝗼𝗱𝗲 𝗥𝗲𝗽𝗼 - Save model project code to Github
🔹 𝗔𝗣𝗜 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 - Use FastAPI or Flask to build a model API
🔹 𝗗𝗼𝗰𝗸𝗲𝗿 - Containerize the ML model API
🔹 𝗥𝗲𝗺𝗼𝘁𝗲 𝗦𝗲𝗿𝘃𝗲𝗿 - Choose a cloud service; e.g. AWS sagemaker
🔹 𝗨𝗻𝗶𝘁 𝗧𝗲𝘀𝘁𝘀 - Test inputs & outputs of functions and APIs
🔹 𝗠𝗼𝗱𝗲𝗹 𝗠𝗼𝗻𝗶𝘁𝗼𝗿𝗶𝗻𝗴 - Evidently AI, a simple, open-source for ML monitoring

𝗣𝗿𝗼𝗰𝗲𝗱𝘂𝗿𝗲

𝗦𝘁𝗲𝗽 𝟭 - 𝗗𝗮𝘁𝗮 𝗣𝗿𝗲𝗽𝗮𝗿𝗮𝘁𝗶𝗼𝗻 & 𝗙𝗲𝗮𝘁𝘂𝗿𝗲 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴

Don't push a model with 90% accuracy on train set. Do it based on the test set - if and only if, the test set is representative of the online data. Use SkLearn pipeline to chain a series of model preprocessing functions like null handling.

𝗦𝘁𝗲𝗽 𝟮 - 𝗠𝗼𝗱𝗲𝗹 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗺𝗲𝗻𝘁

Train your model with frameworks like Sklearn or Tensorflow. Push the model code including preprocessing, training and validation scripts to Github for reproducibility.

𝗦𝘁𝗲𝗽 𝟯 - 𝗔𝗣𝗜 𝗗𝗲𝘃𝗲𝗹𝗼𝗽𝗺𝗲𝗻𝘁 & 𝗖𝗼𝗻𝘁𝗮𝗶𝗻𝗲𝗿𝗶𝘇𝗮𝘁𝗶𝗼𝗻

Your model needs a "/predict" endpoint, which receives a JSON object in the request input and generates a JSON object with the model score in the response output. You can use frameworks like FastAPI or Flask. Containzerize this API so that it's agnostic to server environment

𝗦𝘁𝗲𝗽 𝟰 - 𝗧𝗲𝘀𝘁𝗶𝗻𝗴 & 𝗗𝗲𝗽𝗹𝗼𝘆𝗺𝗲𝗻𝘁

Write tests to validate inputs & outputs of API functions to prevent errors. Push the code to remote services like AWS Sagemaker.

𝗦𝘁𝗲𝗽 𝟱 - 𝗠𝗼𝗻𝗶𝘁𝗼𝗿𝗶𝗻𝗴

Set up monitoring tools like Evidently AI, or use a built-in one within AWS Sagemaker. I use such tools to track performance metrics and data drifts on online data.
Post #1056 4.19K
Application of 1 bit LLM model

1️⃣ In a remote village, a student can use a mobile device with a 1-bit LLM to get personalized tutoring without internet access.

2️⃣ In a low-resource clinic, healthcare workers use a mobile app with a 1-bit LLM to diagnose common diseases from symptoms or images offline.

3️⃣ Farmers use a 1-bit LLM app to diagnose crop diseases and receive personalized farming advice based on soil type and weather patterns

4️⃣ In a disaster-prone area, a 1-bit LLM-powered app helps first responders and citizens communicate critical information in multiple languages offline
Post #1051 5.4K
Dm us on whatsapp for real time training
+9183182 38637

These are the following Training we offer

1- Data Science Training (5 months)
2- GenAI Training (40 days)
3- Mlops Training (40 days)
4- Data analyst Training (45 days)
5- Big data Training ( 60 days)
Post #1044 5.07K
Complete Data Preprocessing video is available on our YouTube channel.

It contains two things
1- Checking the quality of data
2- Doing data cleaning

Steps for checking the quality of data

1- Check the data manually
2- Check for the incorrect data types
3- Check for the spelling errror in the column names
4- Check for the spelling error in the categorical column values
5- Chcek for the negative values in the numerical column
6- Check for the missing values
7- Check for the duplicates values
8- Check for the outliers in the numerical column
9- Check for the data imbalance in the target column
10- Checking for the skeweness in the numerical column
11- Checking for multicollinearity
12- Checking for Cardinality in the categorical columns
13- Encoding the categorical column

Do watch it, like and subscribe to our YouTube channel.
We are aiming for 100 likes on this video. Show your support so that we can keep uploading free content

https://youtu.be/futAzAg99uA?si=NFx1BmSf-6V7xMtr
YouTube Complete Data Preprocessing in Python In this video you will learn about data preprocessing in Python programming. It contains two things 1- Checking the quality of data 2- Doing data cleaning Steps for checking the quality of data 1- Check the data manually 2- Check for the incorrect data…
Older posts →
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook →Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 →