AI Consultant | Machine Learning Solutions

Collection of prompt engineering

Prompty engineering is a critical part in developing AI agent. To make AI function as a particular role, e.g. insuarance salesman, insurance buyer, math teach, ....., it is necessary to write the...

Posted on April 19, 2024 at 10:17 PM

Resource collection of finance LLM

Finance knowledge graph [Github] Financial Knowledge Graphs: small scale of financial knowledge graph, download stock data, visualize graph [Github] Dynamic Knowledge Graph with Large Languag...

Posted on April 18, 2024 at 05:51 PM

MLOps roadmap 2024

The original content is in MLOps roadmap 2024, a wonderful article. I summarize the key points in the post for my reference. ID Description Resources 1 Programming- Python & IDE- Bas...

Posted on April 09, 2024 at 04:49 PM

sympy: a python package for symbolic computation

Do you still remember how to calculate difference, gradient, limit, ... in mathematic? if you forget, never mind. Here is a python package to help you. What you need: know python programming and ...

Posted on April 06, 2024 at 12:18 PM

2024 salary guide (DE, DS,AI) in Singaore

2024 salary guide (thanks recruiter firm sharing) in Singapore. In the report, it predicts demand in AI is increasing. Similarly, in US market, the stocks of AI relevant companies rocket to t...

Posted on April 05, 2024 at 10:38 AM

Singapore AI government resources

The post is credited to LinkedIn https://www.linkedin.com/feed/update/urn:li:activity:7178299726792978432/, shared here as a record. 1. AI Verify Framework🔗 https://lnkd.in/dzKG8ycs 2. Nation...

Posted on March 26, 2024 at 10:27 PM

How to draw animation graph using Graph.io

I often read the posts shared in LinkedIn, which contain the amazing animation graph. So I am thinking how do I also draw it? Previously, I shared a post, Draw.io, a beautiful tool to draw graph ...

Posted on March 22, 2024 at 11:28 AM

How to read annual report

The content in the followinbg is from a post in Linkedin author , Pieter Slegers. It is interesting to share. The 6-step framework from Aswath Damodaran You can steal it here: Have clear ...

Posted on March 21, 2024 at 10:58 PM

Fine-tuning Whisper model for speech recognition

Although OpenAI open-sourced multi-lingual Whisper model, https://github.com/openai/whisper, achived the state-of-art results in the benchmark dataset, there are many scenaria the pretrained mode...

Posted on March 18, 2024 at 10:04 PM

Document summarization and question-answering on document -LLM + LangChain

It is known that large language model (LLM) based chat can answer any query with satisfied accuracy. But when ask questions about the fact, in particular the fact is the latest reported and is no...

Posted on March 10, 2024 at 11:57 PM

Human-like communication with LLM chat agent

Imagine natural talking with your chatGPT rather than mannually input prompt and read the text response. You speak out the information requirement, and the agent speaking out the response. The so...

Posted on February 29, 2024 at 10:42 AM

Streamlit: how to auto play audio, video including video size

I am currently working on the talking avatar project and use streamlit to build the demo. Streamlit audio and video function cannot support autoplay and change video window size when playing. Sea...

Posted on February 22, 2024 at 11:39 PM

Draw.io, a beautiful tool to draw graph and flow

If you have difficulty to drawing a business roadmap flow, product design flow, ......., using MS Office, you can try drawio, a free drawing tool. It is easier to use. You can visit https://app...

Posted on February 07, 2024 at 12:12 PM

YouTube channel is online

Due to the the video costing large storage, I opened a Youtube channel, Aitechcom to share video content. The blog is a mainly host site of text content. Welcome to subscrible my Youtube channel....

Posted on February 02, 2024 at 09:58 AM

Llama.cpp,let running LLM in low vRAM gpu smoooth

It is impossible to running large language model such as LLama having 7B parameters in a consumer GPU, having 10GB vRAM or even lower. Llama.cpp rewrites inferfence using c/c++, and make LLM infe...

Posted on January 22, 2024 at 04:23 PM

Captcha recognition

A CAPTCHA is a type of challenge-response test used in coomputing to determine whether the user is human in order to deter bot attacks and spam. In the captcha test in the website, a captcha imag...

Posted on January 16, 2024 at 10:11 PM

How to setup huggingface environment to save models and data in your specified directory

Normally, when using huggingface to load pretrained model and load data from huggingface, it will check if these models and dataset are available in its cached location. By default, the location ...

Posted on January 11, 2024 at 09:26 PM

Singapore heritage trail: Emerald Hill at orchard

Emerald Hill, one of Singapore heritage trails, enjoy peace and rest in the crowded orchard road. https://youtube.com/shorts/HKMEB2-ycqE?si=ikI1EpGib0KpdBuA

Posted on January 04, 2024 at 09:00 AM

2024 first day: Bukit Timah hill

Time flies so fast. It is 2024 already. Climbing bukit timah hill is a traditional celebration event of new year together with friends. The 2024 first day is great for hiking, a little cloud, no...

Posted on January 01, 2024 at 04:09 PM

Family of otter, wandering neighbourhoods

It happened on Monday, in neighbourhood of hdb building. The family of 4 otters, I think, should come from Alexandra canal, about 500 meters away. Arriving hear they could cross several car ro...

Posted on November 18, 2023 at 09:16 AM

/usr/lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29 not found

In stable diffusion, when using scipy module. Sometime an error happens: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29 not found. Googling cannot find a solution, install lin...

Posted on November 13, 2023 at 10:26 PM

UNet2DConditionModel object has no attribute attn_processors. Did you mean: set_attn_processor

When training lora model using train_text_to_image_lora.py, it reports errors like UNet2DConditionModel object has no attribute attn_processors. Did you mean: set_attn_processor After invest...

Posted on November 13, 2023 at 10:18 PM

Cheap and delicious hawker center lunch at bugis

Can imagine so much cheap food price that locates in bugis? Soups normally $2.5 and meat rice $3. Just in Hdb first floor near kwan im thong hood Cho temple.

Posted on October 12, 2023 at 12:47 PM

Build auto end-to-end image-to-image transformer using stable diffusion web framework

There are many articles, posts or YouTube video teaching how to use stable diffusion web UI framework, https://github.com/AUTOMATIC1111/stable-diffusion-webui/tree/master, to replace face, backgr...

Posted on October 09, 2023 at 11:49 PM

Hiking in Gunung Lambak, Malaysia

On a Saturday, hiking with friends in Gunung Lambak mountain, Malaysia. Leave Singapore early at 5am, still have a traffic jam in second link and spent almost 2 hours enter into Malaysia. Befor...

Posted on October 09, 2023 at 11:19 PM

Looking at the caterpillar, what is your name

Moving Caterpillar Everyday is amazing. Just walking slowly, watching the life. Yay, a caterpillar is coming.

Posted on October 09, 2023 at 11:00 PM

Hiking in windsor nature park

In the weekend, take a 12 km hiking in the Windsor nature park through macritchie trail.

Posted on September 10, 2023 at 01:03 PM

Correctly install sd-webui-train-tools extension in stable diffusion webui to train Lora

The easy practice to train Lora model & evaluate it is to using stable diffusion webui, https://github.com/AUTOMATIC1111/stable-diffusion-webui/tree/master, and install extension sd-webui-tra...

Posted on August 30, 2023 at 12:12 AM

Otter: Have a good day

Otter: good morning. My family come. This is another family of otters, where they sometimes arrive at the Alexandra canal. Not sure it is there home, because they are not found there ever...

Posted on August 03, 2023 at 09:16 AM

Always amazing happens in railway corridor

There is a short time not go to railway corridor to Bukit Timah direction. In the weekend afternoon, have a jogging along the railway, entering from Alexandra road. It is still a little hot a...

Posted on July 30, 2023 at 10:37 PM

Otter is enjoying fish dinner

Everyday is same, cycling from office to home along Singapore river. I know near jiak Kim bridge a family of otters living there. Sometimes I saw them resting on the grass of river bank. Today ...

Posted on July 24, 2023 at 10:05 PM

SQL: Efficiently sort >TB records using row_number

When randomly sampling or tagging records using row number in a table, row_number() plus partition over is often used. For example, if there is a table with schema like, CREATE TABLE IF NOT EX...

Posted on July 17, 2023 at 10:18 PM

Generative ai, big impact on industry and our jobs

From LinkedIn share. You can google title to find original pdf: Title: The economic potential of generative AI : the next productivity frontier. If you cannot find, just comment and let me kno...

Posted on July 10, 2023 at 09:16 PM

Awesome GPT resource

Resource is from https://github.com/formulahendry/awesome-gpt. GPT (Generative Pre-trained Transformer) GPT-4 - OpenAI’s most advanced system, producing safer and more useful responses. ...

Posted on April 24, 2023 at 11:28 PM

Moco based discriminative training

Moco based Fine-tune is good choice in duplicate/near duplicate tasks such as same image/ document detection, person identification, ….. amazing performance increase. As a discriminative training...

Posted on April 21, 2023 at 02:01 PM

Do we need concern openAi governance?

As most already know text-to-image generation from Baidu 文心一言 looks quite bad when the input is Chinese idiom. In the weekend I test it using openAI text-to-image API. Unfortunately I find anoth...

Posted on March 26, 2023 at 10:32 PM

6月学校假期，回中国看望父母，新加坡到北京，北京到山东老家。写篇300字文章

6月的学校假期，我准备回中国看望父母。我从新加坡出发，乘坐飞机来到北京。到达北京后，我先去了父母家，看到父母，我很开心。父母给我准备了很多美食，我们一起吃饭，聊天，回忆过去的日子。接下来，我们一家人乘坐火车去山东老家。到达老家后，我们先去了祖父母家，祖父母看到我们，很开心，给我们准备了很多美食，我们一起吃饭，聊天，回忆过去的日子。接下来，我们去了老家的景点，比如古城、古...

Posted on March 16, 2023 at 12:05 AM

Today marks my 3-year anniversary celebration as a data scientist in lazada

Today marks the 3-year anniversary of my journey as a data scientist at Lazada. It has been an incredible experience and I am so proud of the work I have done and the impact I have made. When I...

Posted on March 15, 2023 at 11:51 PM

Today marks my 3-year anniversary celebration in lazada

Today marks the 3rd anniversary of my journey with Lazada. It has been an amazing journey and I am so proud of all the accomplishments I have achieved in this time. I started out as a customer ...

Posted on March 15, 2023 at 11:48 PM

Reporter story- this morning there is heavy rain. A fallen tree crashed a car and driver is in hospital

John was having a pretty good day. He had just finished his errands and was on his way home when the dark clouds began to roll in. He had heard the forecast for heavy rain, so he decided to take ...

Posted on March 15, 2023 at 11:30 PM

Wonderful night walking along Singapore river

A wonderful night walking along the Singapore River is a great way to enjoy the city’s vibrant nightlife. The Singapore River is lined with restaurants, bars, and clubs, which offer a variety of ...

Posted on March 15, 2023 at 11:20 PM

Amazing travel to Paris

My recent trip to Paris was one of the most amazing travel experiences I've ever had. From the moment I arrived, I was in awe of the city's beauty and charm. Everywhere I looked, there was someth...

Posted on March 15, 2023 at 11:16 PM

ChatGPT: intelligence?

When you test chatGPT, response is amazing. But it still do what data tells it? Open question is very slow response, which indicates it will search deeply it’s knowledge base to try finding answe...

Posted on December 06, 2022 at 07:40 AM

chatGpt: hot chariot, do you really worry?

OpenAI released chatgpt, a strong AI backed chatbot. You can ask anything. After some test, the sentence and paragraph is fluent, at least from my view, a non-native speaker. But almost all fact ...

Posted on December 05, 2022 at 10:38 PM

How to configure Visual Studio Code for C/C++

Visual studio code is a good IDE for code developer, e.g. I am previously coding C++/C using visual studio in Window. But after I move into linux/mac os, I need to find a IDE (free). If you are a...

Posted on December 04, 2022 at 11:04 AM

How to save HTML to image

As I discussed in How to embed matplotlib figure in html, sometime the return from different third-party tools are HTML. In order to merge different analysis into one, I use image as a media. ...

Posted on November 27, 2022 at 05:40 PM

How to embed matplotlib figure in html

Sometime, when we use third-party tool, which may provide visualization using matplotlib to plot figure and visualize the results. It is ok if we only use this tool. However, if we want to integr...

Posted on November 27, 2022 at 05:20 PM

Issue of module not found in Python 3.10

After upgrading python from Python 3.8 to 3.10, modules look installed in virtual environment previously, but cannot import. It will report e.g. module not found numpy, module not found pandas ...

Posted on November 15, 2022 at 08:17 AM

Christmas coming to orchard road

All Christmas decorations ready to show in the orchard road. Shops welcome first normal Christmas after 3-year Covid. Hope everything will be normal soon in the world. So I can back to home town ...

Posted on November 14, 2022 at 08:49 PM

Flowers after night raining 雨后的花

Posted on November 10, 2022 at 08:03 AM

It works to copy custom HTML into post.

The post is to test whether custom HTML can work in wordpress. Unfortunately, only table display and figure cannot. Share strategy backtest report and predicted signal. Not so correct, but ok as ...

Posted on October 26, 2022 at 10:34 PM

How to create long-short strategy using backtrader

In the last post How to build machine learning model to generate trading signal, I share the general processing flow to apply machine learning based signal prediction to create a long strategy. N...

Posted on October 02, 2022 at 12:00 PM

How to build machine learning model to generate trading signal

Recently I am working on how to build machine learning model to predict signal and build a winning strategy. Technical traders will read the price trending curve and use many technical analysis b...

Posted on September 27, 2022 at 11:36 PM

Squirrels swiftly jumping in the tree in the neighborhood.

Posted on September 27, 2022 at 10:18 AM

Night F1 coming again to Singapore. Join the night festival.

Posted on September 27, 2022 at 10:14 AM

Chinese music concert to celebrate Chinese mid-autumn festival at VivoCity Singapore

Today is Chinese mid-autumn festival (中秋节, in Chinese word ). It is a day （团圆 in Chinese) family member are in together just like Christmas. Attending a Chinese music concert to celebrate the day...

Posted on September 10, 2022 at 08:06 PM

Sep 5-10 National lion dance championships 2022

If you are in Singapore, come ngee ann city to watch Singapore National lion dance championship September 5-10

Posted on September 07, 2022 at 07:10 PM

Dog is smart to remember what he wants next

Everyday morning breakfast my dog, erhei, feed up roasted chicken. His best favorite. When taking his outdoor park for shit and urine, back home feed meat in his bowl. But today, I feed meat in h...

Posted on September 02, 2022 at 07:23 AM

Heavy raining in the morning.

Posted on August 26, 2022 at 07:56 AM

Subway museum at prinsep link

Singapore night festival event staring last weekend, know there is a subway museum opened at prinsep link from a LinkedIn post, just a few hundreds of meters from company office. After lunch, wal...

Posted on August 25, 2022 at 08:31 PM