Randomly simulated data is particularly useful when it's real world counterpart is hard access due to complexity, privacy and security reasons. Moreover, randomly simulated data has additional benefits including reproducibility, scalability and controllability.
This application aims to simulate telecommunication payments using random number generation. It includes typical transaction level relationships and behaviours amongst the user, device, ip, and card entities. It can be used in place of real world telecommunication payments for prototyping solutions and as an education tool.
The data generation algorithm works by first generating user level telecom payments data. Afterwards, the user level data is exploded to transaction level, and any inconsistencies within the data model are removed. Finally, the transaction status and error codes are generated using underlying features within the transaction level data.
A stable master version of the Random Telecom Payments data can be found on Kaggle here:
The underlying data model present in the simulated telecommunication payments is displayed below.
For a more detailed account of each column in the dataset see the data dictionary:
- n_users - integer, the number of users to generate Random Telecom Payments data for, default is 100.
- use_random_seed - integer, whether to run the Random Telecom Payments data generation with or without a random seed set for reproducible results; must be 0 or 1.
- n_itr - integer, the number of Random Telecom Payments data batches to generate; must be at least 1. The python multiprocessing library is used to run each in parallel across all available cores.
- n_applications - integer, the number of applications to generate, default is 20000
- registration_start_date - string, the start date for user registrations, default is two years ago from today.
- registration_end_date - string, the end date for user registrations, default is one year ago from today.
- transaction_start_date - string, the start date for user transactions, default is one year ago from today.
- transaction_end_date - string, the end date for user transactions, default is today.
The latest version of the Random Telecom Payments app can be found as a docker image on dockerhub here:
The docker image can be pulled from dockerhub using the following command:
docker pull oislen/randomtelecompayments:latest
The Random Telecom Payments app can then be executed to generate data for 2000 users using the following command and the docker image:
docker run --name rtp oislen/randomtelecompayments:latest --n_users 1000 --use_random_seed 1 --n_itr 2
The generated Random Telecom Payments data can then be extract from the docker image using the following command:
docker cp rtp:/home/user/RandomTelecomPayments/data/RandomTelecomPayments.csv %userprofile%\Downloads\RandomTelecomPayments.csv
Alternatively, a FastApi interface has been configured within the docker image to allow for interaction with the Random Telecom Payments app via REST API calls. The FastApi interface can be accessed by publishing port 8000 when running the docker image as follows:
docker run --name rtp --publish 8000:8000 --entrypoint fastapi --rm oislen/randomtelecompayments:latest run generator/api.py
Once the web endpoint is running, navigate to localhost:8000/docs in your preferred browser to access the FastApi interface documentation and test the available API calls.
