ใใญใผใใชในใใณใฐใไฝฟใฃใฆใฟใ
ใใญใผใใชในใใณใฐใใฉใฎใใใชๆ่กใงๅฎ็พใใใฆใใใฎใ่ๅณใใใฃใใฎใงใไฝฟใฃใฆใฟใพใใใ
ๆฆ่ฆ
ใใญใผใใชในใใณใฐใฏใAI โข Objectives โข Instituteใ่กใฃใฆใใTalk to the City (T3C)ใใญใธใงใฏใใใใผในใซใใฆใใพใใใใฎใใญใธใงใฏใใใชใผใใชใผใฟใณใใใๅฐๆนพใฎๅ้กใซ้ฉ็จใใใจใใซไฝใฃใ้ ่ชใฎใใใงใใ
NotebookLMใซใใใตใใช
ใใฎ่ณๆใฏใTalk to the City (T3C)ใจใใใชใผใใณใฝใผในใฎAIใใผใซใ็ดนไปใใฆใใพใใT3Cใฏใๅคง่ฆๆจกใชๅธๆฐๆ่ฆใๅๆใใๅใ ใฎๆ่ฆใฎๅคๆงๆงใจใใฅใขใณในใ็ถญๆใใชใใใๆฐไธป็ใชๆๆๆฑบๅฎใๅผทๅใใใใจใ็ฎ็ใจใใฆใใพใใๅพๆฅใฎไธ่ซ่ชฟๆปใใใฉใผใซในใฐใซใผใใงใฏๅฐ้ฃใ ใฃใใๅคง่ฆๆจกใใผใฟใใใฎ่ฉณ็ดฐใช่ณช็ๅๆใๅฏ่ฝใซใใ็นใ็นๅพดใงใใๅฐๆนพใๆฅๆฌใฎ้ธๆใใขใกใชใซใฎๅดๅ็ตๅใชใฉใๆงใ ใชๅฎไพใ้ใใฆใใฎๆๅนๆงใ็คบใใใฆใใใAIใๆดป็จใใๆฐไธปไธป็พฉใฎไฟ้ฒใซ่ฒข็ฎใใๅฏ่ฝๆงใ็คบๅใใใฆใใพใใ ้็บใใผใ ใฏใLLMใฎ็ฒพๅบฆๅไธใใฆใผใถใผใคใณใฟใผใใงใผในใฎๆนๅใชใฉใๆดใชใ็ ็ฉถ้็บใ้ฒใใฆใใใใชใผใใณใฝใผในใงใใใใจใใใ็ ็ฉถ่ ใณใใฅใใใฃใจใฎๅๅใไฟ้ฒใใฆใใพใใ
ๅฉ็จไพ
ๅฎ้ใใใฒใใใใฎใตใคใใซใใใใใชไบไพใใใใพใใ
ๅฎ่ก
ไปฅไธใฎzennใซ่จไบใซๆฒฟใฃใฆTalk to the Cityใไฝฟใฃใฆใฟใพใใ
ใพใใgithubใฎใใญใธใงใฏใใcloneใใพใใ
ๅฏพ่ฑกใฎใใผใฟ(csv)ใrawใใผใฟใซใชใฃใฆใใใฎใงใlfsใงใฏใญใผใณใใๅฟ
่ฆใใใใพใใใใใใฏใgithubใใๅๅฅใซcsvใใกใคใซใใใฆใณใญใผใใใฆใOKใงใใ
$ git lfs clone https://github.com/AIObjectives/talk-to-the-city-reportspythonใฎใใผใธใงใณใฏใ3.10ใ3.11ใ่ฏใใใใงใใ
cd ./talk-to-the-city-reports-main/scatter
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt
python -c "import nltk; nltk.download('stopwords')"export OPENAI_API_KEY=sk-proj-XXXXXXXXXX
cd ./pipeline
python main.py configs/example-polis.json
So, here is what I am planning to run:
{'step': 'extraction', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'embedding', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'clustering', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'labelling', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'takeaways', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'overview', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'translation', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'aggregation', 'run': True, 'reason': 'not trace of previous run'}
{'step': 'visualization', 'run': True, 'reason': 'not trace of previous run'}
Looks good? Press enter to continue or Ctrl+C to abort.
Running step: extraction
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 4/4 [00:04<00:00, 1.04s/it]
Running step: embedding
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 1/1 [00:01<00:00, 1.41s/it]
Running step: clustering
File "../talk-to-the-city-reports/scatter/venv/lib/python3.10/site-packages/sentence_transformers/SentenceTransformer.py", line 12, in <module>
from huggingface_hub import HfApi, HfFolder, Repository, hf_hub_url, cached_download
ImportError: cannot import name 'cached_download' from 'huggingface_hub' (.../talk-to-the-city-reports/scatter/venv/lib/python3.10/site-packages/huggingface_hub/__init__.py)ไธ่จใจใฉใผใ็บ็ใใพใใใใ็ฐใชใใใผใธใงใณใฎhuggingface_hubใใคใณในใใผใซใใใใจใงใจใฉใผใๅ้ฟใใใใจใใงใใพใใ
$ pip uninstall -y huggingface_hub
$ pip install huggingface_hub==0.25.2Running step: clustering
2025-01-17 10:01:15,333 - BERTopic - Reduced dimensionality
2025-01-17 10:01:15,336 - BERTopic - Clustered reduced embeddings
Running step: labelling
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 3/3 [00:01<00:00, 2.20it/s]
Running step: takeaways
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 3/3 [00:02<00:00, 1.02it/s]
Running step: overview
Running step: translation
Translating to Mandarin...
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 7/7 [00:13<00:00, 2.00s/it]
Translating to French...
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 7/7 [00:10<00:00, 1.54s/it]
Translating to Mandarin...
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 5/5 [00:11<00:00, 2.26s/it]
Translating to French...
100%|โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ| 5/5 [00:08<00:00, 1.67s/it]
i, id 0 AI should adhere to democratic principles worldwide.
i, id 1 Public awareness about AI and the environment needs improvement
...
Browserslist: caniuse-lite is outdated. Please run:
npx browserslist@latest --update-db
Why you should do it regularly: https://github.com/browserslist/browserslist#browsers-data-updating
Pipeline completed./talk-to-the-city-reports-main/scatter/pipeline/outputs/example-polis/report/index.html
ใใฎใใกใคใซใไฝๆใงใใใใใฐOKใ
Webใขใใชใง้ใใพใใ
$ cd ../next-app
$ npm install
$ npm run devhttp://localhost:3000/report/example-polis
ไปฅไธใ่กจ็คบใใใใฐๆๅใงใใ

ๆฅๆฌ่ชใใญในใ
ๆฅๆฌ่ชใใผใฟใง่ฉฆใใฆใฟใพใใใ
2็ฎๆไฟฎๆญฃใใๅฟ ่ฆใใใใพใใ
example-polis.json
{
ย ย "name": "Recursive Public, Agenda Setting",
ย ย "question": "่ณไธใใฏๆฏๆฐๅไธใซๅฝน็ซใคใ๏ผ",
ย ย "input": "example-polis",
ย ย "model": "gpt-4o",
ย ย "extraction": {
ย ย ย "workers": 3,
ย ย ย "limit": 100
ย ย },
ย ย "clustering": {
ย ย ย "clusters": 6
ย ย },
ย ย "translation": {
ย ย ย "model": "gpt-4o",
ย ย ย "languages": ["Japanese"],
ย ย ย "flags": ["JP"]
ย ย },
ย ย "intro": "This AI-generated report relies on data from a Polis consultation run by the Recursive Public team."
ย }
example-polis.csv
่งฃๆๅฏพ่ฑกใฎๆฅๆฌ่ชใใญในใใๆบๅใใๅฟ
่ฆใใใใพใใ
ใใใงใฏใYahoo!ใใฅใผในใฎใณใกใณใใไฝฟใใพใใใ
ๆใฃๅใๆฉใใใณใกใณใใๅๅพใใใใฃใใฎใงใไปฅไธใฎ่จไบใๅ่ใซใใใผใฟใๅๅพใใพใใใ
็ตๆ
ๅณไธใฎๆฅๆฌ่ชใขใคใณใณใใฏใชใใฏใใใจๆฅๆฌ่ชใง่กจ็คบใใใพใใ


ๆๅพใซ
ใใๆใใซใฉใใชใณใฐใใฆใใใใฎใงใ็ตๆใ่ฆใฆใใฆๆฅฝใใใงใใ
ๅฐๆนพใงใฏๅฎ้ใฎ็คพไผ่ชฒ้กใซๅฏพใใๆๅฟๆฑบๅฎใซไฝฟใใใฆใใใใใชใฎใงใไฝฟใๆนใซใใฃใฆใใใใใชๅฏ่ฝๆงใใใใใใซๆใใพใใ
ไปๅพใฎๅฑ้ใๆฅฝใใฟใงใใ
่ณชๅๆใซๅฏพใใใคใณใฟใฉใฏใใฃใใซใฏใฉในใฟ่กจ็คบ
้ๅฑคๅใฏใฉในใฟ