COMPARING DIFFERENT MODELS FOR CREDIT CARD FRAUD DETECTION
M.tech Pawan Sisodia, department of computer science & Engineering Suresh Gyan vihar University, jaipur
Assistant professor Raminder Kaur, CSE/IT Department Suresh Gyan vihar University, jaipur
ABSTRACT
The Credit Card Fraud detection is a challenging task for researchers as fraudsters are innovative, quick moving individuals. Credit Card fraud detection system is challenging as the dataset provided for credit card fraud detection is very imbalanced, as the quantity of false exchanges is a lot littler than the real ones. Thus, many of fraud detection models got failed due to these data sets. This aim of this research work is to enhance performance of the minority of credit card fraud on the dataset available. So, K-means clustering, logistic regression, random forest and XGBoost models are performed. This research work incorporates the Credit Card Fraud Detection models to study the transactions that end with some frauds. This paper is then used to distinguish whether payment transactions are fraud or not. This research work is to identify totally the false transactions while avoiding the incorrect fraud classifications. Different algorithms are implemented in this paper. Python Machine Learning libraries are used to perform those algorithms. The models studied in this research work are K-Nearest Neighbour, logistic regression, random forest model, XGBoost model. XGBoost is showing more accuracy then other models. Out of these algorithms, XGBoost model is preferable over Random Forest model and Logistic regression model.
Keywords: Credit Card Fraud Detection, K-Means Clustering, Logistic Regression, Random Forest, XGBoost Model
- INTRODUCTION
The Credit Card Fraud detection is a challenging task for researchers as fraudsters are innovative, quick moving individuals. This Research is done to prevent the problem of society. With the normal procedure it is not possible to perform a fraud. The scamster must do their work with great confidence and sharply. So, businesses as well as academic communities are developing credit card fraud detection models. In this study, different approaches to fraud detection are presented. This study investigates the usefulness of applying different approaches to a problem of Credit card fraud detection.
The principle kind of credit card extortion is illegal use of Lost and Stolen Cards. Creating Fake and Doctored Cards is in the cutting edge procedures, wherein the data is hung on either the attractive strip on the rear of the credit card, or the data set aside on the savvy chip is copied beginning with one card then onto the following. Phishing websites are changing into a standard method of blackmail with a talented hacking limit. These kinds of the pages are proposed to get individuals to give their credit-cards details effectively without recognizing they have been frauded. Triangulation is comparably another method. Triangulation is the point at which a seller offers a thing at an incredibly unassuming cost through a site. At the point when clients attempt to submit the request of the item, the transporter urges to the customers or clients who are in snare, to pay by methods for email if the item is gotten by him. The seller uses a misleading card details for buying the item from a site and sends the thing to the buyer, who at that point send the trader their credit card details by means of email. The trader continues working along these lines utilizing the credit-card numbers given by buyers for buying; showing up for a brief time frame to be the individual closes the web page and begins another one.
Credit-card misrepresentation can be done in two ways, either offline or online misrepresentation (fraud). The possibilities of offline fraud are by having a stolen physical card at client confronting venue or by call center. The card issuing banks or organizations can jolt it before it is used in a bogus manner. Online misrepresentation is submitted through phone shopping, web or when cardholders not present. The loss of individual data straightforwardly adds to developing misrepresentation misfortunes for banks and merchants. It is important to collect key details for reasons of breaches to avoid losses from financial service organization. This information is planned to help extortion supervisory groups figure out where holes exist in the security issues in this industry.
- RELATED WORK
[1] Portrayed highlights key experiences and customary terms in Credit card coercion and figures in this type of fraud. Dependent upon the kind of distortion looked by credit card companies or banks; various counters measures can be gotten and completed. The proposals made were presumably going to had favorable characteristics with respect to cost investment funds and time productivity. [2] Three procedures to recognize coercion were presented. At first, gathering model was used to arrange the legal and phony exchange using data clustering of areas of parameter regard. Also, Gaussian blend model was utilized to show the likelihood thickness of credit card client’s past direct with the target that the likelihood of current lead can be set out to perceive any assortments from the standard from the past direct. Finally, Bayesian frameworks were utilized to delineate the estimations of a specific client and the encounters of various pressure conditions. The standard endeavor was to investigate various perspectives on a comparable issue and see what can be gotten from the utilization of every novel system. [3] used machine learning AI methods for data mining to recognize extortion in a progressing exchange on the web, and as such organizing the exchange of information as genuine or suspicious. [4] They have implemented different extortion recognition framework such as Support Vector Machine (SVM), K-Nearest0Neighbor (KNN), Hidden Markov Model, Artificial Neural Networks (ANN), Bayesian Network, Fuzzy0Logic0Based0System and Decision Trees. According to the requirement a fair audit was done0on the current and proposed0models for credit card extortion discovery and has completed a near report on these strategies based on quantitative estimations, for example, exactness, recognition rate and false alert rate. The end of the examination clarifies the downsides of existing0models and gives a superior security0arrangements.
III. DATASET
The data set used in the proposed work is provided by Kaggle. There are overall 30 features. But 28 out of them are renamed as V1 through V28. All are numeric values. The remaining three features are the time, transaction amount status of the transaction, it was fraudulent or not. The exact details of the features are hidden for confidentiality. The, Class, response variable is 1 for fraudulent transaction and 0 for safe transactions. Supervised approach is used in this work. There are no missing values in the data set.
- IMPLEMENTATION
System Configuration
In this research, all the tests are performed under following specifications:
Host System: Intel i3 processor with 4 GB RAM and 500GB Hard disk.
Operating Environment: Windows10
IDE: Visual StudioCode
Programming Language: Python (v3.6)
Algorithms Implemented
To predict whether a transaction is fraudulent, machine learning models are implemented. The following models are implemented.
- K Nearest Neighbors (KNN)
- Logistic regression
- Support vector classifier
- Random forest
- XGBoost
K Nearest Neighbors
In the classification setting, the KNN8algorithm is forming a majority vote between the K most similar instances to a given unseen observation. Similarity is defined according to a distance metric between two data points x and x0 . A popular choice is the Euclidean distance given by
Suppose the K points in the training data that are closest to x are denoted as set A. It then estimates0the conditional0probability for each class, i.e, the fraction0of points in A with that given class label.
Where I(x) is the indicator function which evaluates to T1 when the argument x is true and T otherwise Finally, the input x is assigned to the class with the largest probability.
Output generated by proposed work:
Logistic Regression and Support Vector Classifier
Logistic regression introduced by David Cox, 1958 is a model in which the response variable Y is categorical. SVM introduced by Vapnik, 1995 was to solve the classification and regression problems. It is used to implement an optimal hyper0plane for maximizing the margin between two classes.
To get learning much faster on large datasets, class SGDClassifier implements SGD training with multiple linear classifiers.
Output : 0.8075666039570759
We have 492 fraud data points and 284315 non-fraudulent data points.
and the generated output is:
Random Forest
The random forest algorithm by L. Breiman, 2001, has0been successful as a general-purpose classification and regression method. This approach uses several randomized decision trees and aggregates their predictions by averaging, has shown excellent performance in the setting having greater the number of observations then the number of variables.
Output: 0.8567203839327452
As compared to SVC, random forest performed very well.
XGBoost
XGBoost model is also compared, which is based on Gradient Boosted Trees and is a more powerful model compared to both Logistic Regression and Random Forest.
XGBoost uses the gradient boosting (GBM) framework at its core. It uses the features of scikit-learn library. It is an optimized distributed gradient boosting library. But wait, what is boosting. Xgboost is effective for data in tabular form having limited variables set.
TEST SET EVALUATION OF THE BEST MODEL
According to the cross-validated MCC scores, the0best-performing model is random forest, evaluating its performance:
For Random Forest Model
For XGBoost Model
According to the0MCC, the performance of random forest is not so effective on the0training set.
- CONCLUSION
The proposed methodology adopted is proficient and viable. The random forest model and XGBoost are options to precisely recognize fraudulent credit card transactions. We found that the five factors V17, V14, V10, V12, and V11 are most associated with fraud. The fraud transactions can look fundamentally the same as standard exchanges; it is hard to place them into a different gathering dependent on highlights alone. The K-implies grouping model delivered a low precision of 54.27%. Subsequently, K-means would not be the favored model for this data set, as it didn’t effectively anticipate cheats and it likewise created a great deal of false positives. The strategic relapse gave us the best outcomes. The logistic regression gave us an extraordinary precision rate of 99.88%, with 0.079% of the approval set being false negatives (or 0.49% of the number of frauds). It has been appeared even a logistic regression model can accomplish great review, while a significantly more complex Random Forest model enhances strategic relapse as far as AUC. Be that as it may, XGBoost model enhances the two models. The Random forest model can be improved further by manipulating the hyper parameters.
VI. FUTURESCOPE
Issues of Fraud detection are mind-boggling require a considerable measure before the implementation of AI algorithms. The utilization of AI algorithms and business analytics ensures that the cash of the customers will be safe and not effectively messed with. In future work, Random forest mode would be improved for detecting fraudulent transactions.
REFERENCES
[1] Linda Delamaire, Hussein Abdou and John Pointon (2009)”Credit card fraud and detection techniques: a review” Banks and Bank Systems, Volume 4, Issue 2, 2009
[2] V. Dheepa, and Dr. R.Dhanapal (2009) “Analysis of Credit Card Fraud Detection Methods” International Journal of Recent Trends in Engineering, Vol 2, No. 3, November 2009
[3] John Akhilomen(2013) “Data Mining Application for Cyber Credit-Card Fraud Detection System” Advances in Data Mining. Applications and Theoretical Aspects pp 218-228
[4] Excell D. Bayesian inference—the future of online fraud protection. Computer Fraud and Security. 2012; 2012(2):8–11.
[5] Lu Q, Ju C. Research on credit card fraud detection model based on class weighted support vector machine. Journal of Convergence Information Technology. 2011;6(1):62–68.
[6] Juszczak P, Adams NM, Hand DJ, Whitrow C, Weston DJ. Off-the-peg and bespoke classifiers for fraud detection. Computational Statistics and Data Analysis. 2008;52(9):4521–4532.
[7] Bhattacharyya S, Jha S, Tharakunnel K, Westland JC. Data mining for credit card fraud: a comparative study. Decision Support Systems. 2011;50(3):602–613.
[8] Francisca NO. Data mining application in credit card fraud detection system. Journal of Engineering Science and Technology. 2011;6(3):311–322.
[9] Duman E, Ozcelik MH. Detecting credit card fraud by genetic algorithm and scatter search. Expert Systems with Applications. 2011;38(10):13057–13063.
[10] Srivastava A, Kundu A, Sural S, Majumdar AK. Credit card fraud detection using hidden Markov model.IEEE Transactions on Dependable and Secure Computing. 2008;5(1):37–48.
[11] Chan PK, Fan W, Prodromidis AL, Stolfo SJ.Distributed data mining in credit card fraud detection.IEEE Intelligent Systems and Their Applications. 1999;14(6):67–74.]
[12] N. Sivakumar and Dr.R.Balasubramanian (2015) “Fraud Detection in Credit Card Transactions: Classification, Risks and Prevention Techniques” International Journal of Computer Science and Information Technologies, Vol. 6 (2) , 2015, 1379-1386
[13] IbtissamBenchaji,SamiraDouzi,andBouabid El Ouahidi (2018) “Using Genetic Algorithm to Improve Classification of Imbalanced Datasets for credit card fraud detection” 2nd Cyber Security in Networking Conference (CSNet)
[14] Yashvi Jain, NamrataTiwari, ShripriyaDubey and Sarika Jain (2019) “A Comparative Analysis of Various Credit Card Fraud Detection Techniques” International Journal of Recent Technology and Engineering (IJRTE) ISSN: 2277-3878, Volume-7 Issue-5S2, January 2019
[15] R. M. jamailesmaily, “Intrusion detection system based on multilayer perceptron neural networks and decision tree,” in International conference on Information and Knowledge Technology, 2015.
[16] S.P. Tanmay Kumar Behera, “credit card fraud detection: a hybrid approach using fuzzy clustering and neural network,” in international conference on advances in computing and communication Engineering, 2015.
[17] P. K. D. K. R. D. A. A. ThurayaRazoogi, Credit card fraud detection using fuzzy logic and neural networks, Society for modeling and simulation International (SCS), 2016.
[18] Zojaji et al. 2016] Zojaji, Z.; Atani, R. E.; Monadjemi,A. H.; et al. 2016. A survey of credit card fraud detection techniques: data and technique-oriented perspective.arXivpreprint arXiv: 1611.06439.