From cfab46c577b962b218fa45d75518a142283d49bd Mon Sep 17 00:00:00 2001 From: Gray Egboluche <69684799+G-r-ay@users.noreply.github.com> Date: Thu, 1 Jun 2023 05:33:44 -0700 Subject: [PATCH] Update hackathon_data_faq.md --- docs/hackathon_data_faq.md | 142 +++++++++++++------------------------ 1 file changed, 50 insertions(+), 92 deletions(-) diff --git a/docs/hackathon_data_faq.md b/docs/hackathon_data_faq.md index f3b406e..816e0c2 100644 --- a/docs/hackathon_data_faq.md +++ b/docs/hackathon_data_faq.md @@ -1,120 +1,78 @@ ---- +# ODC's Role in Addressing Sybil and Fraud: Collecting and Curating Strategic Datasets -# Hackathon Datasets +One responsibility that the ODC has taken on for the broader anti-Sybil and anti-Fraud community is to collect addresses that are very likely to be either Sybils or non-Sybils. We have inherited the nomenclature of the FDD from Gitcoin, which initially collected many of these wallets and collected them into Sybil "Loki" and non-Sybil "Thor" datasets. Due to the sensitivity of these datasets, we restrict access to those that are actively participating in Hackathons or otherwise active in the OpenData Community. The ODC has published our plans on how to curate and improve these strategic datasets on our [Forum](https://forum.opendatacommunity.org/t/an-ongoing-responsibility-the-collection-of-sybil-and-non-sybil-lists/42). -This page lists many datasets available for OpenData Community (ODC) Hackathons! This collection of datasets is made up of old and new data to start off work on the Hackathon bounties. As a data analyst and scientist you may also wish to develop your own sources of data including via the use of ODC supported projects such as TrueBlocks and Data Dex. +Please get in touch to donate or help to gather valuable datasets or to provide feedback or assistance. -One responsibility that the ODC has taken on for the broader anti-Sybil and anti-Fraud community is to collect addresses that are very likely to be either Sybils or non-Sybils. We have inhereted the nomenclature of the FDD from Gitcoin, which initially collected many of these wallets and collected them into Sybil "Loki" and non-Sybil "Thor" datasets. Due to the sensitivity of these data sets we restrict access to those that are actively participating in Hackathons or otherwise active in the OpenData Community. The ODC has published our plans on how to currate and improve these strategic datasets on our Forum here: -- [ -https://forum.opendatacommunity.org/t/an-ongoing-responsibility-the-collection-of-sybil-and-non-sybil-lists/)42](https://forum.opendatacommunity.org/t/an-ongoing-responsibility-the-collection-of-sybil-and-non-sybil-lists/42) - -Please get in touch to donate or help to gather valuable data sets or to provide feedback or assistance. - -Note - for those datasets hosted on the Ocean Protocol - you may want to use: -https://faucet.polygon.technology - -You need to hit the drop down list at the top and select the Mumbai network to see the data assets. This makes all the claims free. +You need to hit the drop-down list at the top and select the Mumbai network to see the data assets. This makes all the claims free. For hackathon participants, you will also need to have shared with us your wallet ID via the Buidlbox site in order to be added to the whitelist. Or just DM epowell101 on our Discord. -When in doubt - take a look at [odc.oceanprotocol.com](https://odc.oceanprotocol.com/) or at the IPFS files also below. Also please drop into the hackathon support channel and ask around. As of May 2nd 2023 for example multiple participants are sharing datasets and collaborating in other ways. - -That Discord channel is here: [invite](https://discord.gg/9KqPFfE2DF) - +When in doubt, take a look at [odc.oceanprotocol.com](https://odc.oceanprotocol.com/) or at the IPFS files also below. Also, please drop into the hackathon support channel and ask around. As of May 2nd, 2023, for example, multiple participants are sharing datasets and collaborating in other ways. -## Grant Analysis +That Discord channel is here: [invite](https://discord.gg/9KqPFfE2DF) -For analysis of activity during the Beta round: - - [Beta round applicants/projects](https://odc.oceanprotocol.com/asset/did:op:5aed4e636258b47f6ee06ce3f6f29834cbb3dfe67fd34e50e5174d5886ff234c) - - [Beta rounds](https://odc.oceanprotocol.com/asset/did:op:ccfb322ba5367626239032874b8ba851302a7c573c6649f17019c84e8630620d) +# ODC Datasets -- Also - via IPFS - you should be able to access the following files **updated May 12th:** +This page lists many datasets available for OpenData Community (ODC) Hackathons! This collection of datasets is made up of old and new data to start off work on Hackathon bounties or Lego development. As a data analyst and scientist you may also wish to develop your own sources of data including via the use of ODC supported projects such as TrueBlocks and Data Dex. - [Beta Round Stats -> what are the rounds, how many grants in each round?](https://ipfs.io/ipfs/QmeuaS1k84bfNwYVMnkqC26rsPdmZqrcBRwCTWK1rJB1gJ?filename=QmeuaS1k84bfNwYVMnkqC26rsPdmZqrcBRwCTWK1rJB1gJ) +You may want to use [Polygon Faucet](https://faucet.polygon.technology/) for datasets hosted on the Ocean Protocol. - [Beta Round Data Set -> summary stats at the time this was gathered by each round](https://ipfs.io/ipfs/Qmf8FfDzneM2on6HStm7b5EEDVadqpKgmWgfddaBDbNH4R?filename=Qmf8FfDzneM2on6HStm7b5EEDVadqpKgmWgfddaBDbNH4R) +## Grant Datasets - [Beta Round Overall Round Data -> more metadata like cap level and summary info](https://ipfs.io/ipfs/QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh?filename=QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh) +| Dataset | Link | Description | Platform | Round | +|---------|------|-------------|----------|-------| +| Beta round applicants/projects | [link](https://odc.oceanprotocol.com/asset/did:op:5aed4e636258b47f6ee06ce3f6f29834cbb3dfe67fd34e50e5174d5886ff234c) | Dataset containing information about Beta round applicants/projects | Ocean Protocol | Beta | +| Beta rounds | [link](https://odc.oceanprotocol.com/asset/did:op:ccfb322ba5367626239032874b8ba851302a7c573c6649f17019c84e8630620d) | Dataset related to the Beta rounds | Ocean Protocol | Beta | +| Beta Round Stats | [link](https://ipfs.io/ipfs/QmeuaS1k84bfNwYVMnkqC26rsPdmZqrcBRwCTWK1rJB1gJ?filename=QmeuaS1k84bfNwYVMnkqC26rsPdmZqrcBRwCTWK1rJB1gJ) | Dataset providing information about the rounds and number of grants in each round | IPFS | Beta | +| Beta Round Dataset | [link](https://ipfs.io/ipfs/Qmf8FfDzneM2on6HStm7b5EEDVadqpKgmWgfddaBDbNH4R?filename=Qmf8FfDzneM2on6HStm7b5EEDVadqpKgmWgfddaBDbNH4R) | Summary statistics of each round at the time it was gathered | IPFS | Beta | +| Beta Round Overall Round Data | [link](https://ipfs.io/ipfs/QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh?filename=QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh) | More metadata like cap level and summary information about the Beta round | IPFS | Beta | +| Beta Round Projects | [link](https://ipfs.io/ipfs/QmNyWTCYfTGepoCYosGwB56uUhkYrvASEBex911QFrPFHq?filename=QmNyWTCYfTGepoCYosGwB56uUhkYrvASEBex911QFrPFHq) | Detailed data on each potential grantee, including rejected projects with votes and more | IPFS | Beta | +| Beta Round Votes | [link](https://ipfs.io/ipfs/Qmaf4U2MJUzEcf1BZx9RBpoANoxwA2rkYugcugtfS9oHoN?filename=Qmaf4U2MJUzEcf1BZx9RBpoANoxwA2rkYugcugtfS9oHoN) | A CSV of voters along with details about their voting | IPFS | Beta | +| All rounds | [link](https://odc.oceanprotocol.com/asset/did:op:ef68dd422b0dbedab081608718d716c7b5211c612083dcb00948b4fb54543027) | - | Ocean Protocol | | +| Grant round datasets (3 - 15) | [link](https://fddhub.io/downloads/grant_rounds) | Grant round data fromgrant round 3 - 15 | FddHub | GR<=15 | +| Beta round payout | TBA | TBA | TBA | Beta | +| All projects | [link](https://odc.oceanprotocol.com/asset/did:op:9cc281937e6d600824691e69972b74b4bee15d00c59e120a8c3aec2b992f463b) | - | Ocean Protocol | - | +| Alpha round outputs - OSS | [link](https://odc.oceanprotocol.com/asset/did:op:966806aeda72dde815bc0db8405d0a7854a91e8b6e59fcfed3cc73e88b597254) | - | Ocean Protocol | Alpha | +| Alpha round outputs - Eth | [link](https://odc.oceanprotocol.com/asset/did:op:2a42c7b5aaab7c16f892d7b57d31bee65aa77c5e34f8c2ab8a907f004076159e) | - | Ocean Protocol | Alpha | +| Alpha round outputs - Climate | [link](https://odc.oceanprotocol.com/asset/did:op:c75cb1a6e76d3d61d3ad085219745db225fbc043f34b7a2be00b3705deb5c382) | - | Ocean Protocol | Alpha | - [Beta Round Projects -> Lots of data on each potential grantee including rejected ones w/ votes and more](https://ipfs.io/ipfs/QmNyWTCYfTGepoCYosGwB56uUhkYrvASEBex911QFrPFHq?filename=QmNyWTCYfTGepoCYosGwB56uUhkYrvASEBex911QFrPFHq) - [Beta_Round_Votes -> transactions by wallet and more](https://ipfs.io/ipfs/Qmaf4U2MJUzEcf1BZx9RBpoANoxwA2rkYugcugtfS9oHoN?filename=Qmaf4U2MJUzEcf1BZx9RBpoANoxwA2rkYugcugtfS9oHoN) +___ You can always sanity check your figures vs. the dashboard published by Gitcoin here: [Gitcoin Beta Round Dashboard](https://gitcoin-grants.streamlit.app/) +___ -For analysis of activity during and after the Beta round: - - - [All rounds](https://odc.oceanprotocol.com/asset/did:op:ef68dd422b0dbedab081608718d716c7b5211c612083dcb00948b4fb54543027) - - [Grant round datasets (3 - 15)](https://fddhub.io/downloads/grant_rounds) - - [Beta rounds](https://odc.oceanprotocol.com/asset/did:op:ccfb322ba5367626239032874b8ba851302a7c573c6649f17019c84e8630620d) - - [All projects](https://odc.oceanprotocol.com/asset/did:op:9cc281937e6d600824691e69972b74b4bee15d00c59e120a8c3aec2b992f463b) - -[Grant round datasets (3 - 15)](https://fddhub.io/downloads/grant_rounds) - - [Alpha round outputs - OSS](https://odc.oceanprotocol.com/asset/did:op:966806aeda72dde815bc0db8405d0a7854a91e8b6e59fcfed3cc73e88b597254) - - [Alpha round outputs - Eth](https://odc.oceanprotocol.com/asset/did:op:2a42c7b5aaab7c16f892d7b57d31bee65aa77c5e34f8c2ab8a907f004076159e) - - [Alpha round outputs - Climate](https://odc.oceanprotocol.com/asset/did:op:c75cb1a6e76d3d61d3ad085219745db225fbc043f34b7a2be00b3705deb5c382) - - [Beta round applicants/projects](https://odc.oceanprotocol.com/asset/did:op:5aed4e636258b47f6ee06ce3f6f29834cbb3dfe67fd34e50e5174d5886ff234c) - - [Beta round votes](https://odc.oceanprotocol.com/asset/did:op:fae52359f6c0d1de9d71a94cf2729d9d07628367733975b8572db0f90ee29aed) - - Beta round payout - TBC - -## Sybil Analysis +## Sybil Datasets -Useful for analysis of models with the help of likely Sybils for training and back testing: +Here are some datasets with likely Sybils for back testing and training your cool algorithms, analyses, or even models.Please keep in mind that these datasets are access controlled, so please visit our [discord](https://discord.gg/9KqPFfE2DF) for additional information on how to access them. - - [Alpha Round Sybils](https://odc.oceanprotocol.com/asset/did:op:e3952ec9d82b35a6258851ac668190213c72f1babcf5a641b919504b7843fe6e) - - [Gr15 Squelching list](https://odc.oceanprotocol.com/asset/did:op:19acd2448e278b09d99eff56e24307317c5ee006b4660ce2b12b3451da03ac24) - - [Passport addresses and scores (Alpha round)](https://odc.oceanprotocol.com/asset/did:op:266bb73082f9598dd20b18eb04821be100ceadff4efd070962971338abc2e706) - - [Thor/Loki dataset with Lego scores](https://odc.oceanprotocol.com/asset/did:op:1b26eda361c6b6d307c8a139c4aaf36aa74411215c31b751cad42e59881f92c1) +| Dataset | Link | Description | Platform | +|---------|------|-------------|----------| +| Alpha Round Sybils | [link](https://odc.oceanprotocol.com/asset/did:op:e3952ec9d82b35a6258851ac668190213c72f1babcf5a641b919504b7843fe6e) | Dataset of likely sybils from the Alpha Round | Ocean Protocol | +| Gr15 Squelching list | [link](https://odc.oceanprotocol.com/asset/did:op:19acd2448e278b09d99eff56e24307317c5ee006b4660ce2b12b3451da03ac24) | Dataset containing the Gr15 Squelching list | Ocean Protocol | +| Passport addresses and scores (Alpha round) | [link](https://odc.oceanprotocol.com/asset/did:op:266bb73082f9598dd20b18eb04821be100ceadff4efd070962971338abc2e706) | Dataset with passport addresses and scores from the Alpha round | Ocean Protocol | +| Thor/Loki dataset with Lego scores | [link](https://odc.oceanprotocol.com/asset/did:op:1b26eda361c6b6d307c8a139c4aaf36aa74411215c31b751cad42e59881f92c1) | Dataset containing Thor/Loki data with Lego scores | Ocean Protocol | For analysis of activity during and after the Beta round: - - Final Beta round passport scores - TBC +- Final Beta round passport scores - TBC ## IPFS raw files The following files can also be useful. In some cases these are duplicates of the above. -**Allo Datasets (Present and Future) - -[All Allo rounds](https://ipfs.io/ipfs/QmQc26bJimoDgMbh1Q3kkvPNoSHHNjcMc5TJmx49XycgC7) -Dataset of all rounds stored on the Allo Protocol -CID: QmQc26bJimoDgMbh1Q3kkvPNoSHHNjcMc5TJmx49XycgC7 - -[Beta rounds](https://ipfs.io/ipfs/QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh) -Dataset of Beta rounds on the Allo Protocol -CID: QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh - -[All Allo projects](https://ipfs.io/ipfs/Qmf3nwPDW5G3nGnkjV5uc1DvsAG9jNeNEqAR18t5orPySc) -List of all projects stored on the Allo Protocol -CID: Qmf3nwPDW5G3nGnkjV5uc1DvsAG9jNeNEqAR18t5orPySc - -[Beta applicants/projects](https://ipfs.io/ipfs/QmNyWTCYfTGepoCYosGwB56uUhkYrvASEBex911QFrPFHq) -List of Beta round specific projects from the Allo Protocol -CID: QmNyWTCYfTGepoCYosGwB56uUhkYrvASEBex911QFrPFHq - -[Beta round votes](https://ipfs.io/ipfs/Qmaf4U2MJUzEcf1BZx9RBpoANoxwA2rkYugcugtfS9oHoN) -List of votes/contributions to Beta round projects from the Allo Protocol -CID: Qmaf4U2MJUzEcf1BZx9RBpoANoxwA2rkYugcugtfS9oHoN - -Beta round payout - TBC - -Passport Datasets (Past, Present and Future) - - [Passport addresses and scores (past)](https://ipfs.io/ipfs/QmW7rmERMSHbQWENaDR2Yw13JJAbCFPEwExo44hyA8koaf?filename=passport_address_scores.csv) - List of addresses and their passport score - CID: QmW7rmERMSHbQWENaDR2Yw13JJAbCFPEwExo44hyA8koaf - -[Grant round datasets (3 - 15)](https://data.opendatacommunity.org/) - -[Alpha round outputs/OSS](https://ipfs.io/ipfs/QmUcbv46EAnrMETXSevJDfekVv7UXyULDsZwL1fPotYySC?filename=oss_output.csv) - Final output for the Open Source Software pool of the Gitcoin Alpha round - CID: QmUcbv46EAnrMETXSevJDfekVv7UXyULDsZwL1fPotYySC - -[Alpha round outputs/Eth](https://ipfs.io/ipfs/QmXdpqdPaWniUn4LbKPBWXYW3R8nsRb3abvDaaUMfqQzJB?filename=eth_output.csv) - Final output for the Ethereum Infrastructure pool of the Gitcoin Alpha round - CID: QmXdpqdPaWniUn4LbKPBWXYW3R8nsRb3abvDaaUMfqQzJB - -[Alpha round outputs/Climate](https://ipfs.io/ipfs/QmWejV3B89BPVeh2Lv6QoUoyMSdZgXNzDYqjDcWTf1AV2Y?filename=climate_output.csv) - Final output for the Climate Change pool of the Gitcoin Alpha round - CID: QmWejV3B89BPVeh2Lv6QoUoyMSdZgXNzDYqjDcWTf1AV2Y - +| Dataset | Link | Description | CID | +|---------|------|-------------|-----| +| All Allo rounds | [link](https://ipfs.io/ipfs/QmQc26bJimoDgMbh1Q3kkvPNoSHHNjcMc5TJmx49XycgC7) | Dataset of all rounds stored on the Allo Protocol | QmQc26bJimoDgMbh1Q3kkvPNoSHHNjcMc5TJmx49XycgC7 | +| Beta rounds | [link](https://ipfs.io/ipfs/QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh) | Dataset of Beta rounds on the Allo Protocol | QmWx9MtUgaauXCGpn1CXNaXLcrAtx9qqEH49oguqutz7Yh | +| All Allo projects | [link](https://ipfs.io/ipfs/Qmf3nwPDW5G3nGnkjV5uc1DvsAG9jNeNEqAR18t5orPySc) | List of all projects stored on the Allo Protocol | Qmf3nwPDW5G3nGnkjV5uc1DvsAG9jNeNEqAR18t5orPySc | +| Beta round payout - TBC | - | - | - | +| Passport addresses and scores (past) | [link](https://ipfs.io/ipfs/QmW7rmERMSHbQWENaDR2Yw13JJAbCFPEwExo44hyA8koaf?filename=passport_address_scores.csv) | List of addresses and their passport score | QmW7rmERMSHbQWENaDR2Yw13JJAbCFPEwExo44hyA8koaf | +| Grant round datasets (3 - 15) | [link](https://data.opendatacommunity.org/) | - | - | +| Alpha round outputs/OSS | [link](https://ipfs.io/ipfs/QmUcbv46EAnrMETXSevJDfekVv7UXyULDsZwL1fPotYySC?filename=oss_output.csv) | Final output for the Open Source Software pool of the Gitcoin Alpha round | QmUcbv46EAnrMETXSevJDfekVv7UXyULDsZwL1fPotYySC | +| Alpha round outputs/Eth | [link](https://ipfs.io/ipfs/QmXdpqdPaWniUn4LbKPBWXYW3R8nsRb3abvDaaUMfqQzJB?filename=eth_output.csv) | Final output for the Ethereum Infrastructure pool of the Gitcoin Alpha round | QmXdpqdPaWniUn4LbKPBWXYW3R8nsRb3abvDaaUMfqQzJB | +| Alpha round outputs/Climate | [link](https://ipfs.io/ipfs/QmWejV3B89BPVeh2Lv6QoUoyMSdZgXNzDYqjDcWTf1AV2Y?filename=climate_output.csv) | Final output for the Climate Change pool of the Gitcoin Alpha round | QmWejV3B89BPVeh2Lv6QoUoyMSdZgXNzDYqjDcWTf1AV2Y | + +___