不积跬步,无以至千里
不积小流,无以成江海

Great journeys begin with small steps;
mighty rivers grow from little streams.

Don't Make the Mistake of Thinking That What's Now Happening is Mostly About Tariffs (from X, Ray Dalio)

Don't Make the Mistake of Thinking That What's Now Happening is Mostly About Tariffs  At this moment, a huge amount of attention is being justifiably paid to the announced tariffs and their ver...

Deploy local chatgpt or deepseek like application using gptme

If you are concern privacy issue or cost of running agent based application, now you can do it by setup local application using GPTME: personal AI assistant/agent in your terminal. Currently the ...

Hallucination (error) never disappears in LLM because of its probability nature

Today another bad practice (Hallucination) using generative AI in product is pop up in news and social media. Here is a report from BBC Google remakes Super Bowl ad after AI cheese gaffe. Halluci...

Fine-tuning NER vs LLM prompt for asset ticker extraction in finance UGC

With the increasing multiple-task capability of LLM model, it makes it easy to do specific ML task by prompting LLM to focus on specified task, such as sentiment classification, name entity recog...

DuckDB: an efficient SQL development in Python

After a few weeks using DuckDb to develop product, particularly to handle complex data processing logic (e.g. multiple table join, condition, group, expand, cross-database operation, ...), I like...

Resource sharing for AI fintech product development

# Fintech product development collection - Common financial risk and performance metrics. Used by zipline and pyfolio, [empyrical](https://github.com/quantopian/empyrical/tree/master) - Pytho...

How to solve aiohttp.ClientSession failure: Client error for XXX: Can not write request body for API_URL

aiohttp_ClientSession_issue Investigate aiohttp.ClientSession randomly failure when batch calling APIs, e.g. Client error for XXX: Can not write request body for API_URL What is the issue? ...

AGI, I don’t expect what I can see.

AGI, not PR AGI, is not possible, at least in next years. But text, vision, multi-modal foundation models make it easy to develop AI/ML based applications using domain knowledge to tailor llm to ...

Remote conntection disconnected in FastAPI server

When I develop LLM agent based service (e.g. call openAI api async) using multiple workers to parallel processing large requests, I use uvicorn in APP code to start multiple workers. In server si...

Daily update signal forecasting for QQQ [Update 2024-11-26]

Currently I am working on FinAgent, leverage LLM to analyze historical price, LLM agent, reflection, and reinforcement learning to forecast signal for stock. After doing a lot experiments using a...

LLM in finance: paper collection

Based on preliminary results, LLM + agent + reflection looks positive in stock market information fusion and signal prediction. The following are paper list collected. FinLlama: Financial Sen...

Summary of overseas scholarship for Singaporean and PR in Singapore

There are many scholarships available for Singaprean and PR to support students to pursue undergraduate study in local or overseas, which scholarships are from government and industry (Famous com...

Why your fastapi response slow, even after increasing computing resource

FastAPI is a poppolar framework to build API service. It is easy to use, fast and support async requests. FastAPI support multiple workers and parallel high volume (middle level) requests. But wh...

How to install Phi-3-vision 128k onnx

Open-source LLMs (text modality) are involution and competitive among the AI companies. There are also quantization optimized small LLMs available (e.g. llm.cpp, ollama), which are running realti...

How to patch Python project into executable command

It is not easy to deploy a Python project in cross-platform and cross-machine. You need spend time to prepare requirements.txt and solve the package version conflict. If project can be processed ...

Fix error when install ta-lib:

ta-lib is a popular open-source to calculatte technical analysis indicators in finace anaylysis. But when you install pip installl ta-lib The following error occurs ERROR: Could not build w...

Competitive intelligence in e-commerce: all about product pricing and assortment

In the current e-commerce market, competitio is brutal, particularly in southeast asia market, where the resident income is very low. Low price is at the top priority in online shopping. As more ...

Role-play AI agent

AI agent is amazing, promising, and useful in many business scenaria. With the increasing capability of large language model such as ChatGPT-4 and opensource models such as Llama3, it beccomes ea...

Collection of prompt engineering

Prompty engineering is a critical part in developing AI agent. To make AI function as a particular role, e.g. insuarance salesman, insurance buyer, math teach, ....., it is necessary to write the...

Resource collection of finance LLM

Finance knowledge graph [Github] Financial Knowledge Graphs: small scale of financial knowledge graph, download stock data, visualize graph [Github] Dynamic Knowledge Graph with Large Languag...

MLOps roadmap 2024

The original content is in MLOps roadmap 2024, a wonderful article. I summarize the key points in the post for my reference. ID Description Resources 1 Programming- Python & IDE- Bas...

sympy: a python package for symbolic computation

Do you still remember how to calculate difference, gradient, limit, ... in mathematic? if you forget, never mind. Here is a python package to help you. What you need: know python programming and ...

2024 salary guide (DE, DS,AI) in Singaore

2024 salary guide (thanks recruiter firm sharing) in Singapore. In the report, it predicts demand in AI is increasing. Similarly, in US market, the stocks of AI relevant companies rocket to t...

Singapore AI government resources

The post is credited to LinkedIn https://www.linkedin.com/feed/update/urn:li:activity:7178299726792978432/, shared here as a record. 1. AI Verify Framework🔗 https://lnkd.in/dzKG8ycs 2. Nation...

How to draw animation graph using Graph.io

I often read the posts shared in LinkedIn, which contain the amazing animation graph. So I am thinking how do I also draw it? Previously, I shared a post, Draw.io, a beautiful tool to draw graph ...

How to read annual report

The content in the followinbg is from a post in Linkedin author , Pieter Slegers. It is interesting to share. The 6-step framework from Aswath Damodaran You can steal it here: Have clear ...

Fine-tuning Whisper model for speech recognition

Although OpenAI open-sourced multi-lingual Whisper model, https://github.com/openai/whisper, achived the state-of-art results in the benchmark dataset, there are many scenaria the pretrained mode...

Document summarization and question-answering on document -LLM + LangChain

It is known that large language model (LLM) based chat can answer any query with satisfied accuracy. But when ask questions about the fact, in particular the fact is the latest reported and is no...

Human-like communication with LLM chat agent

Imagine natural talking with your chatGPT rather than mannually input prompt and read the text response. You speak out the information requirement, and the agent speaking out the response. The so...

Streamlit: how to auto play audio, video including video size

I am currently working on the talking avatar project and use streamlit to build the demo. Streamlit audio and video function cannot support autoplay and change video window size when playing. Sea...

Draw.io, a beautiful tool to draw graph and flow

If you have difficulty to drawing a business roadmap flow, product design flow, ......., using MS Office, you can try drawio, a free drawing tool. It is easier to use. You can visit https://app...

YouTube channel is online

Due to the the video costing large storage, I opened a Youtube channel, Aitechcom to share video content. The blog is a mainly host site of text content. Welcome to subscrible my Youtube channel....

Llama.cpp,let running LLM in low vRAM gpu smoooth

It is impossible to running large language model such as LLama having 7B parameters in a consumer GPU, having 10GB vRAM or even lower. Llama.cpp rewrites inferfence using c/c++, and make LLM infe...

Captcha recognition

A CAPTCHA is a type of challenge-response test used in coomputing to determine whether the user is human in order to deter bot attacks and spam. In the captcha test in the website, a captcha imag...

How to setup huggingface environment to save models and data in your specified directory

Normally, when using huggingface to load pretrained model and load data from huggingface, it will check if these models and dataset are available in its cached location. By default, the location ...

Singapore heritage trail: Emerald Hill at orchard

Emerald Hill, one of Singapore heritage trails, enjoy peace and rest in the crowded orchard road. https://youtube.com/shorts/HKMEB2-ycqE?si=ikI1EpGib0KpdBuA

2024 first day: Bukit Timah hill

Time flies so fast. It is 2024 already. Climbing bukit timah hill is a traditional celebration event of new year together with friends. The 2024 first day is great for hiking, a little cloud, no...

Family of otter, wandering neighbourhoods

It happened on Monday, in neighbourhood of hdb building. The family of 4 otters, I think, should come from Alexandra canal, about 500 meters away. Arriving hear they could cross several car ro...

/usr/lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29 not found

In stable diffusion, when using scipy module. Sometime an error happens: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29 not found. Googling cannot find a solution, install lin...

UNet2DConditionModel object has no attribute attn_processors. Did you mean: set_attn_processor

When training lora model using train_text_to_image_lora.py, it reports errors like UNet2DConditionModel object has no attribute attn_processors. Did you mean: set_attn_processor After invest...

Cheap and delicious hawker center lunch at bugis

Can imagine so much cheap food price that locates in bugis? Soups normally $2.5 and meat rice $3. Just in Hdb first floor near kwan im thong hood Cho temple.

Build auto end-to-end image-to-image transformer using stable diffusion web framework

There are many articles, posts or YouTube video teaching how to use stable diffusion web UI framework, https://github.com/AUTOMATIC1111/stable-diffusion-webui/tree/master, to replace face, backgr...

Hiking in Gunung Lambak, Malaysia

On a Saturday, hiking with friends in Gunung Lambak mountain, Malaysia. Leave Singapore early at 5am, still have a traffic jam in second link and spent almost 2 hours enter into Malaysia. Befor...

Looking at the caterpillar, what is your name

Moving Caterpillar Everyday is amazing. Just walking slowly, watching the life. Yay, a caterpillar is coming.

Hiking in windsor nature park

In the weekend, take a 12 km hiking in the Windsor nature park through macritchie trail.

Correctly install sd-webui-train-tools extension in stable diffusion webui to train Lora

The easy practice to train Lora model & evaluate it is to using stable diffusion webui, https://github.com/AUTOMATIC1111/stable-diffusion-webui/tree/master, and install extension sd-webui-tra...

Otter: Have a good day

Otter: good morning. My family come. This is another family of otters, where they sometimes arrive at the Alexandra canal. Not sure it is there home, because they are not found there ever...

Always amazing happens in railway corridor

There is a short time not go to railway corridor to Bukit Timah direction. In the weekend afternoon, have a jogging along the railway, entering from Alexandra road. It is still a little hot a...

Otter is enjoying fish dinner

Everyday is same, cycling from office to home along Singapore river. I know near jiak Kim bridge a family of otters living there. Sometimes I saw them resting on the grass of river bank. Today ...

SQL: Efficiently sort >TB records using row_number

When randomly sampling or tagging records using row number in a table, row_number() plus partition over is often used. For example, if there is a table with schema like, CREATE TABLE IF NOT EX...

Generative ai, big impact on industry and our jobs

From LinkedIn share. You can google title to find original pdf: Title: The economic potential of generative AI : the next productivity frontier. If you cannot find, just comment and let me kno...

Awesome GPT resource

Resource is from https://github.com/formulahendry/awesome-gpt. GPT (Generative Pre-trained Transformer) GPT-4 - OpenAI’s most advanced system, producing safer and more useful responses. ...

Moco based discriminative training

Moco based Fine-tune is good choice in duplicate/near duplicate tasks such as same image/ document detection, person identification, ….. amazing performance increase. As a discriminative training...

Do we need concern openAi governance?

As most already know text-to-image generation from Baidu 文心一言 looks quite bad when the input is Chinese idiom. In the weekend I test it using openAI text-to-image API. Unfortunately I find anoth...

6月学校假期,回中国看望父母,新加坡到北京,北京到山东老家。写篇300字文章

6月的学校假期,我准备回中国看望父母。 我从新加坡出发,乘坐飞机来到北京。到达北京后,我先去了父母家,看到父母,我很开心。父母给我准备了很多美食,我们一起吃饭,聊天,回忆过去的日子。 接下来,我们一家人乘坐火车去山东老家。到达老家后,我们先去了祖父母家,祖父母看到我们,很开心,给我们准备了很多美食,我们一起吃饭,聊天,回忆过去的日子。 接下来,我们去了老家的景点,比如古城、古...

Today marks my 3-year anniversary celebration as a data scientist in lazada

Today marks the 3-year anniversary of my journey as a data scientist at Lazada. It has been an incredible experience and I am so proud of the work I have done and the impact I have made. When I...

Today marks my 3-year anniversary celebration in lazada

Today marks the 3rd anniversary of my journey with Lazada. It has been an amazing journey and I am so proud of all the accomplishments I have achieved in this time. I started out as a customer ...

Reporter story- this morning there is heavy rain. A fallen tree crashed a car and driver is in hospital

John was having a pretty good day. He had just finished his errands and was on his way home when the dark clouds began to roll in. He had heard the forecast for heavy rain, so he decided to take ...

Wonderful night walking along Singapore river

A wonderful night walking along the Singapore River is a great way to enjoy the city’s vibrant nightlife. The Singapore River is lined with restaurants, bars, and clubs, which offer a variety of ...

Amazing travel to Paris

My recent trip to Paris was one of the most amazing travel experiences I've ever had. From the moment I arrived, I was in awe of the city's beauty and charm. Everywhere I looked, there was someth...