Idea / Why / Story ?
Changedetect is a tools to detect the change(s) of a webpage(s) by visiting it regularly. When it found a change(s) (text based, picture not supported) in the webpage. it can send out an alert. (message or GET / POST request).
I implemented an endpoint to receive that request. (for example: job post url of the job found)
Passing it to an playwright instance and extract the content (e.g. JOB_POST_CONTENT).
Combine it with my portfolio (e.g. LOUIS_PORTFOLIO) and generate an resume (e.g. GEN_RESUME).
The LLM model used was deepseek.
Things not implemented
- To investigate the background of the company. The background of the company was provided by extraction of the jobpost at the implementation. One better things is that the background can be found by something ike sherlock.
- The lack of resources of LLM. at the moment of creating this project. The LLM can do the search to the internet already. however it is a paid service.
Current situation (at the moment of implementation):
- I've wrote a lot of scrapers in my codebase. (serve as a RAG for my own)
- I've wrote a lot of AI prompt in my codebase. (serve as a RAG for my own)
- I've wrote a lot of docker in my codebase. (serve as a RAG for my own)
- It is simple to make use of them to create a AI automation flow
Flow / Block diagram
- Fetch the varices list from jobsdb
- Scrape detail of varices jobsdb
- Filter the job with matched nature/requirements
- If:
- Yes, send a notification to me
- No, review if the reason is technical
- If the reason is technical, summarize it and send to me (such that I can update my portfolio under the table)
Conclusion
- This project served as a kind of proof-of-concept(POC) level only. It is technically possible however it consumes LLM token a lot.
- It also explore some un-official way to use deepseek(a.k.a. UI reverse proxy) xtekky/deepseek4free instead of common AI-API calling.
However this kind of calling lacks of role support which make it slightly unuseable. (e.g.
system,agent,user) - It craft/draft/temporize the AI of my projects(pet-projects) should look like.
- It also provide a switching capability to the paid official api (however small refactoring work needed)