f7d53acdde
support get sqlpass api by configuration
2025-02-19 14:37:21 -06:00
a8810519f8
optimize instructions configuration
...
optimize drilldown part logic
2025-02-04 15:29:24 -06:00
f9ef4cec96
update sql_query cache file store location
...
At most cache 5 days, then clean from local disk.
2025-01-31 10:59:54 -06:00
b15d260a58
migrate name mapping algorithm from Ravi
2025-01-21 16:55:08 -06:00
2eace81f51
support more configurable parts
2025-01-16 13:54:45 -06:00
a89aa9c4de
support fetch data from Prospectus
2025-01-14 16:21:48 -06:00
9348e32caa
support more performance fee keywords
2025-01-06 13:14:20 -06:00
75ea5e70de
1. support fetch data from messy-code page by ChatGPT4o Vision function.
...
2. multilingual share features configuration
2024-12-09 17:47:42 -06:00
a25991e2bb
1. Set TOR reported name priority
...
2. Optimize investment mapping logic
2024-12-06 09:54:43 -06:00
a11a99fdc3
1. Optimize instructions: not to fetch the data with "up to" statement.
...
2. Add exception handler in function.
2024-12-03 11:27:28 -06:00
bc32860f87
remove_abundant_data
2024-12-02 17:16:56 -06:00
c146497052
optimize share feature judgment logic:
...
accumulation with capitalisation and institutional
income with distribution
Document: 337293427
2024-12-02 13:11:49 -06:00
276ff93a1d
Optimize drilldown algorithm
...
Share class names with currency
Reason
The currency in document not next to share name
Solution
If can't get relevant text from PDF page contents, and the last word of share class name belongs to currency, remove currency from share class name, then try again.
After implementing this solution, recall is from 95% to 96%
Can't find relevant text from current PDF page text
Reason
Hence apply try to merge previous page text into current page, perhaps the text is from previous page text.
Solution
Try to get previous page and search relevant value.
After implementing this solution, recall is from 96% to 98%.
2024-11-26 16:35:07 -06:00
a09778d9d1
Create EMEA AR API code file.
...
Optimize annotation list for drilldown.
2024-11-26 11:24:29 -06:00
fb356fce76
1. optimize drilldown algorithm
...
2. support calculate drilldown recall metrics
2024-11-25 15:11:03 -06:00
fc80093557
optimize investment mapping
2024-11-22 14:54:52 -06:00
f1c0290588
Optimize investment mapping algorithm.
...
1. Get proper currency if exist multiple currencies in share name, e.g. CHF EUR
2. Default currency should be based on scenario: USD or EUR.
3. Remove special chars should be based on \W, instead of [^a-zA-Z0-9\s]
2024-11-21 16:36:58 -06:00
5b9f9416de
1. Update for mapping multilingual share class names.
...
2. Optimize getting currency logic
2024-11-21 11:37:58 -06:00
7a41b03634
1. optimize instructions for fund name
...
2. optimize drilldown logic
2024-11-12 17:01:10 -06:00
c2d2e54670
"total match" logic for single word value, need consider the "\n" char scenario
2024-11-12 11:40:19 -06:00
5b67bd332b
optimize drilldown algorithm
2024-11-12 11:20:38 -06:00
c6c3e99d3e
integrate pdf drilldown logic to pdf_util.py
2024-11-11 16:34:25 -06:00
c34e2e960e
optimize drilldown algorithm
2024-11-08 15:00:34 -06:00
81f855f725
support drilldown data to PDF
2024-11-08 11:22:35 -06:00
81a424b00d
Support replaces share class name in database to be more readable.
...
Examples document 532422720
M&G European Credit Investment Fund A CHFH Acc -> M&G European Credit Investment Fund A CHF H Accumulation
M&G European Credit Investment Fund A CHFHInc -> M&G European Credit Investment Fund A CHF H Income
M&G European High Yield Credit Investment Fund E GBPHedgedAcc -> M&G European High Yield Credit Investment Fund E GBP Hedged Accumulation
2024-11-05 11:14:56 -06:00
fa763f4f14
1. optimize instructions
...
2. optimize mapping algorithm
2024-10-24 16:24:21 -05:00
171f3b6d1f
optimize for OGC data extraction.
2024-10-23 16:07:54 -05:00
f166e73362
optimize data extraction algorithm: if can't find cost numeric value from PDF page text, then extract data by Vision ChatGPT
2024-10-15 15:57:54 -05:00
17284c74f0
optimize for investment mapping: share feature logic
2024-10-09 14:07:07 -05:00
04a2409c58
optimize investment mapping algorithm
2024-10-08 23:53:55 -05:00
aa2c2332ae
optimize for more cases
2024-10-08 17:16:01 -05:00
8bd6008425
refactor code
2024-10-07 10:34:13 -05:00
f0dd7f9e89
Consider multiple share short names cases.
2024-10-02 17:25:25 -05:00
edb90c718e
Optimize mapping algorithm
...
Consider some share class names are with multiple short name, e.g.
CPR Invest Global Disruptive Opportunities Class I sw EUR - Acc
The short names are I and sw
The purpose is to support get all of short names from share class name.
2024-10-02 15:08:26 -05:00
3bb13947af
Optimize mapping algorithm:
...
For multiple currencies in fund/ share name, if exist USD, remove it
Fix the issue for split words without space
If there is no currency in share class name, try to get same currency from document mapping which with same fund name and same short share class name.
2024-10-02 13:25:08 -05:00
f06355e0c8
optimize mapping algorithm: check whether exist "-" to connect share names
2024-10-02 11:38:11 -05:00
035f028155
optimize mapping algorithm
2024-10-01 16:46:59 -05:00
3adbd7631a
optimize mapping algorithm
2024-10-01 15:31:15 -05:00
d92053a16e
optimize mapping metrics algorithm
2024-10-01 12:19:45 -05:00
18174bf1cf
optimize mapping: choose proper candidates mapping list.
2024-10-01 11:35:29 -05:00
60a26377e5
optimize investment mapping algorithm
2024-09-30 16:32:56 -05:00
3aa596ea33
optimize mapping logic
2024-09-27 16:39:56 -05:00
39cd53dc33
support calculate mapping metrics based on document investment mapping in database
2024-09-27 13:20:50 -05:00
0c4c541319
optimize mapping algorithm, this is the fixed version to confirm mapping metrics
2024-09-27 09:25:11 -05:00
7eba9a52ae
recover algorithm to the better version
2024-09-26 19:25:17 -05:00
d25bae936c
Optimize investment mapping algorithm.
2024-09-26 12:18:37 -05:00
598e2ab820
investment mapping: optimize for currency logic
2024-09-25 17:28:22 -05:00
dd6701f18c
1. optimize investment mapping algorithm
...
2. realize investment mapping metrics
2024-09-25 15:15:38 -05:00
0f14bf4a7a
1. get document/ provider mapping data
...
2. optimize metrics algorithm
3. Expand max token length since switch ChatGPT4o to 2024-08-06 version.
2024-09-23 17:21:02 -05:00
8496c7b5ed
optimize instructions
...
optimize metrics algorithm
2024-09-20 16:46:44 -05:00
Blade He