Turkiye Klinikleri Journal of Biostatistics

.: REVIEW
Model Performans Kriterlerinin Kronolojisine ve Metodolojik Yönlerine Genel Bir Bakış: Bir Gözden Geçirme
An Overview of Chronology and Methodological Aspects of Model Performance Criteria: A Review
İsmet DOĞANa, Nurhan DOĞANa
aAfyonkarahisar Sağlık Bilimleri Üniversitesi Tıp Fakültesi, Biyoistatistik ve Tıbbi Bilişim ABD, Afyonkarahisar, TÜRKİYE
Turkiye Klinikleri J Biostat. 2020;12(1):114-25
doi: 10.5336/biostatic.2019-71069
Article Language: TR
Full Text
ÖZET
 Modeller, tahminin en önemli bileşenidir. Ancak her veri kümesi farklı ilişkileri tanımlaması gereken farklı değişken türleri içermektedir ve her model tipinin veri seti ile ilgili kısıtlamaları bulunmaktadır. Bu nedenle, aranan ilişkiyi doğru tanımlayabilecek tahmin modelinin seçilmesi önemlidir. Model seçimi ile ilgili literatürde yer alan çalışmalar, örneklem büyüklüğü, model yapısı, verilerin dağılımı, tahmin yöntemleri ve modelde yer alan değişken sayısı gibi birçok faktörün model seçim kriterlerinin sonuçlarını etkilediğini göstermiştir. Bu durum araştırmacıların en iyi model seçim kriterini ve özelliklerini merak etmelerine neden olmaktadır. Modeli doğrulayan indeksleri kullanmak yerine, modelin verilere uygunluğunu en iyi şekilde değerlendiren uygun indekslerin seçilmesi önerilmesine rağmen, pratikte bu durum oldukça zor ve karmaşıktır. Her ne kadar çalışmalarda bir modeli değerlendirmek için bazı kriterlerin kullanılması önerilmesine rağmen, her bir çalışmada kullanılan veriler birbirinden tamamen farklı olacağından, bu önerilerin genelleştirilemediği görülmektedir. Nicel bir ölçüt olan model değerlendirme kriterleri, tanımlayıcı yeterlilik, basitlik ve genelleştirilebilirlik gibi özellikler içermektedir. Bir modelin yeterliliğini tam olarak değerlendirmek için bu üç özelliğin üçünün de aynı anda değerlendirilmesi gerekmektedir. Çalışmanın amacı, çeşitli performans kriterlerine ve bunların sınıflandırılmasına yönelik genel bir bakış sağlamaktır.

Anahtar Kelimeler: Performans ölçüleri; modelleme; model seçimi
ABSTRACT
 Models are the most important component of estimation. However, each dataset contains different types of variables that need to define different relationships, and each model type has constraints on the dataset. Thus, it is important to select forecasting model that can define the sought relationship properly. Studies in the literature on model selection have shown that many factors such as sample size, model structure, distribution of data, estimation methods, and number of variables in the model affect the results of the model selection criteria. This makes researchers wonder about the best model selection criteria and features. Although it is recommended to select appropriate indexes that best evaluate the suitability of the model to data rather than using indexes that confirm the model, in practice this is quite difficult and complex. Although some criteria are suggested to evaluate a model in the studies, it is seen that these recommendations cannot be generalized because the data used in each study will be completely different from each other. Model evaluation criteria, which are quantitative measures, include descriptive adequacy (whether the model fits observed data), simplicity (whether the model's description of observed data is achieved in the simplest possible manner) and generalizability (whether the model provides a good predictor of future observations). To fully assess the adequacy of a model, all three of these features need to be evaluated at the same time. The aim of the study is to provide an overview of the various performance criteria and their classification.

Keywords: Performance metrics; modeling; model selection
REFERENCES:
  1. Forster MR. Key concepts in model selection: performance and generalizability. J Math Psychol. 2000;44(1):205-31. [Crossref]  [PubMed] 
  2. Sayyareh A, Obeidi R, Bar-Hen A. Empiricial comparison between some model selection criteria. Commun Stat Simulat. 2010;40(1):72-86. [Crossref] 
  3. Botchkarev A. A new typology design of performance metrics to measure errors in machine learning regression algorithms. IJIKM. 2019;14:45-76. [Crossref] 
  4. Kadane JB, Lazar NA. Methods and criteria for model selection. J Am Stat Assoc. 2004;99(465):279-90. [Crossref] 
  5. Pearson K. Karl Pearson's Early Statistical Papers. 1st ed. Cambridge: Cambridge University Press; 1948. p.557.
  6. Fox DG. Judging air quality model performance. B Am Meteorol Soc. 1981;62(5):599-609. [Crossref] 
  7. Muroi H, Takeshita Y, Adachi S. Model validation criteria for system identification in time domain. T Soc Instr Control Eng. 2015;51(10):80-91. [Crossref] 
  8. Duveiller G, Fasbender D, Meroni M. Revisiting the concept of a symmetric index of agreement for continuous datasets. Sci Rep-UK. 2016;6:19401. [Crossref]  [PubMed]  [PMC] 
  9. Theil H. Economic Forecasts and Policy. 2nd ed. Amsterdam: North-Holland Pub Co;1961. p.657.
  10. Legates DR, McCabe GJ. Evaluating the use of goodness of fit measures in hydrologic and hydroclimatic model validation. Water Resour Res. 1999;35(1):233-41. [Crossref] 
  11. Krause P, Boyle DP, Base F. Comparison of different efficiency criteria for hydrological model assessment. ADGEO. 2005;5:89-97. [Crossref] 
  12. Gupta HV, Kling H, Yilmaz KK, Martinez GF. Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling. J Hydrol. 2009;377(1-2):80-91. [Crossref] 
  13. Kling H, Fuchs M, Paulin M. Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios. J Hydrol. 2012;424-425:264-77. [Crossref] 
  14. Akaike H. A new look at the statistical model identification. IEEE T Automat Contr. 1974;19(6):716-23. [Crossref] 
  15. Sawa T. Information criteria for discriminating among alternative regression models. Econometrica. 1978;46(6):1273-91. [Crossref] 
  16. Schwarz G. Estimating the dimension of a model. Ann Statist. 1978;6(2):461-4. [Crossref]  [Crossref] 
  17. Hannan EJ, Quinn BG. The determination of the order of an autoregression. J Roy Stat Soc B Met. 1979;41(2):190-5. [Crossref] 
  18. Hurvich CM, Tsai CL. Regression and time series model selection in small samples. Biometrika. 1989;76(2):297-307. [Crossref] 
  19. Mallows CL. Some comments on Cp. Technometrics. 1973;15(4):661-75. [Crossref]  [Crossref] 
  20. Hocking RR. A biometrics invited paper. The analysis and selection of variables in linear regression. Biometrics. 1976;32(1):1-49. [Crossref] 
  21. Golub GH, Heath M, Wahba G. Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics. 1979;21(2):215-23. [Crossref] 
  22. Amemiya T. Selection of regressors. Int Econ Rev. 1980;21(2):331-54. [Crossref] 
  23. Geweke J, Meese R. Estimating regression models of finite but unknown order. Int Econ Rev. 1981;22(1):55-70. [Crossref] 
  24. Shibata R. An optimal selection of regression variables. Biometrika. 1981;68(1):45-54. [Crossref] 
  25. Rissanen J. Stochastic complexity. J Roy Stat Soc B Met. 1987;49(3):223-9. [Crossref] 
  26. Robinson WS. The statistical measurement of agreement. Am Sociol Rev. 1957;22(1):17-25. [Crossref] 
  27. Nash JE, Sutcliffe JV. River flow forecasting through conceptual models: part I-A discussion of principles. J Hydrol. 1970;10(3):282-90. [Crossref] 
  28. Willmott CJ. On the validation of models. Phys Geog. 1981;2(2):184-94. [Crossref] 
  29. Mielke PW Jr. The application of multivariate permutation methods based on distance functions in the earth sciences. Earth-Sci Rev. 1991;31(1):55-71. [Crossref] 
  30. Loague K, Green RE. Statistical and graphical methods for evaluating solute transport models: overwiev and application. J Contam Hydrol. 1991;7(1-2):51- 73. [Crossref] 
  31. Watterson LG. Non-dimensional measures of climate model performance. Int J Climatol. 1996;16(4):379-91. [Crossref] 
  32. Ji L, Gallo K. An agreement coefficient for image comparison. Photogramm Eng Rem S. 2006;72(7):823-33. [Crossref] 
  33. Fisher RA. A mathematical examination of the methods of determining the accuracy of an observation by the mean error, and by the mean square error. Mon Not R Astron Soc. 1920;80(8):758-70. [Crossref] 
  34. Patry GG, Marino MA. Nonlinear runoff modelling: parameter identification. J Hydraul Eng. 1983;109(6):865-80. [Crossref] 
  35. Manley RE. Calibration of hydrological model using optimization technique. J Hydraul Div ASCE. 1978;189-202.
  36. Stephenson D. Direct optimization of Muskingum routing coefficients. J Hydrol. 1979;41(1-2):161-5. [Crossref] 
  37. Dust M, Baran N, Errera G, Hutson JL, Mouvet C, Schafer H, et al. Simulation of water and solute transporte in field soils with the LEACHP model. Agr Water Manage. 2000;44(1-3):225-45. [Crossref] 
  38. Nayak PC, Sudheer KP, Rangan DM, Ramasastri KS. A neuro-fuzzy computing technique for modeling hydrological time series. J Hydrol. 2004;291(1- 2):52-66. [Crossref] 
  39. Willmott CJ, Robeson SM, Matsuura K. Short communication: a refined index of model performance. Int J Climatol. 2012;32(13):2088-94. [Crossref] 
  40. Joreskog KG. A general method for estimating a linear structural equation system. In: Goldberger AS, Duncan OD, eds. Structural Equation Models in the Social Sciences. 1st ed. New York: Seminar Press; 1973. p.83-112.
  41. Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38(1):1-10. [Crossref] 
  42. Wheaton B, Muthén B, Alwin DF, Summers GF. Assessing reliability and stability in panel models. Sociol Methodol. 1977;8:84-136. [Crossref] 
  43. Bentler PM, Bonett DG. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull. 1980;88(3):588-606. [Crossref] 
  44. Joreskog KG, Sorbom D. Lisrel V. Analysis of Linear Structural Relations by the Method of Maximum Likelihood. 2nd ed. Chicago: International Educational Services; 1981.
  45. Hoelter JW. The analysis of covariance structures. Sociol Method Res. 1983;11(3):325-44. [Crossref] 
  46. Bollen KA. A new incremental fit index for general structural equation models. Sociol Method Res. 1989;17(3):303-16. [Crossref] 
  47. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238-46. [Crossref]  [PubMed] 
  48. McDonald RP, Marsh HW. Choosing a multivariate model: noncentrality and goodness of fit. Psychol Bull. 1990;107(2):247-55. [Crossref] 
  49. Browne MW, Cudeck R. Alternative ways of assessing model fit. Sociol Method Res. 1992;21(2):230-58. [Crossref] 
  50. Steiger JH. Point estimation, hypothesis testing and interval estimation using the RMSEA: some comments and a reply to Hayduk and Glaser. Struct Equ Modeling. 2000;7(2):149-62. [Crossref] 
  51. Ding J, Tarokh V, Yang Y. Model selection techniques: an overview. IEEE Signal Proc Mag. 2018;35(6):16-34. [Crossref] 
  52. Pereira HR, Meschiatti MC, Pires RCM, Blain GC. On the performance of three indices of agreement: an easy-to-use r-code for calculating the Willmott indices. Bragantia. 2018;77(2):394-403. [Crossref] 
  53. Maydeu-Olivares A, Garcia-Forero C. Goodness-of-fit testing. International Encyclopedia of Education; 2010. p.190-6. [Crossref] 
  54. Dziak JJ, Coffman DL, Lanza ST, Li R. Sensitivity and specificity of information criteria. PeerJ Preprints. 2017:5:e1103v3. [Crossref] 
  55. Navarro DJ, Myung JJ. Model evaluation. In: Everitt B, Howel D, eds. Encyclopedia of Statistics in Behavioral Science. 1st ed. New York: John Wiley & Sons; 2005. p.1239-42. [Crossref] 
  56. Rakotoasimbola E, Blili S. Measures of fit impacts: application to the causal model of consumer involvement. Int J Market Res. 2019;61(1):77-92. [Crossref] 
  57. Willmott CJ, Matsuura K. Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Clim Res. 2005;30(1):79-82. [Crossref] 
  58. Willmott CJ, Matsuura K, Robeson SM. Ambiguities inherent in sums-of-squares-based error statistics. Atmos Environ. 2009;43:749-52. [Crossref] 
  59. Lin TH, Dayton CM. Model selection information criteria for non-nested latent class models. J Educ Behav Stat. 1997;22(3):249-64. [Crossref] 
  60. Nadif M, Govaert G. Clustering for binary data and mixture models--choice of the model. Appl Stoch Model D A. 1998;13(3-4):269-78. [Crossref] 
  61. McDonald RP. An index of goodness-of-fit based on noncentrality. J Classif. 1989;6(1):97-103. [Crossref] 
  62. Guse B, Pfannerstill M, Gafurov A, Kiesel J, Lehr C, Fohrer N. Identifying the connective strength between model parameters and performance criteria. Hydrol Earth Syst Sci. 2017;21(11):5663-79. [Crossref] 

.: Up To Date

Login

 Forgot your password?

 New Registration  

Contact

Ortadoğu Reklam Tanıtım Yayıncılık Turizm Eğitim İnşaat Sanayi ve Ticaret A.Ş.

.: Address

Turkocagi Caddesi No:30 06520 Balgat / ANKARA
Phone: +90 312 286 56 56
Fax: +90 312 220 04 70
E-mail: info@turkiyeklinikleri.com

.: Manuscript Editing Department

Phone: +90 312 286 56 56/ 2
E-mail: yaziisleri@turkiyeklinikleri.com

.: English Language Redaction

Phone: +90 312 286 56 56/ 145
E-mail: tkyayindestek@turkiyeklinikleri.com

.: Marketing Sales-Project Department

Phone: +90 312 286 56 56/ 142
E-mail: reklam@turkiyeklinikleri.com

.: Subscription and Public Relations Department

Phone: +90 312 286 56 56/ 118
E-mail: abone@turkiyeklinikleri.com

.: Customer Services

Phone: +90 312 286 56 56/ 118
E-mail: satisdestek@turkiyeklinikleri.com

1. TERMS OF USE

1.1. To use the web pages with http://www.turkiyeklinikleri.com domain name or the websites reached through the sub domain names attached to the domain name (They will be collectively referred as "SITE"), please read the conditions below. If you do not accept these terms, please cease to use the "SITE." "SITE" owner reserves the right to change the information on the website, forms, contents, the "SITE," "SITE" terms of use anytime they want.

1.2. The owner of the "SITE" is Ortadoğu Advertisement Presentation Publishing Tourism Education Architecture Industry and Trade Inc. (From now on it is going to be referred as "Turkiye Klinikleri", shortly) and it resides at Turkocagi cad. No:30, 06520 Balgat Ankara. The services in the "SITE" are provided by "Turkiye Klinikleri."

1.3. Anyone accessing the "SITE" with or without a fee whether they are a natural person or a legal identity is considered to agree these terms of use. In this contract hereby, "Turkiye Klinikleri" may change the stated terms anytime. These changes will be published in the "SITE" periodically and they will be valid when they are published. Any natural person or legal identity benefiting from and reaching to the "SITE" are considered to be agreed to any change on hereby contract terms done by "Turkiye Klinikleri."

1.4. The "Terms of Use" hereby is published in the website with the last change on March 30th 2014 and the "SITE" is activated by enabling the access to everyone. The "Terms of Use" hereby is also a part of the any "USER Contract" was and/or will be done with the users using "Turkiye Klinikleri" services with or without a fee an inseparable.

2. DEFINITIONS

2.1. "SITE": A website offering different kind of services and context with a certain frame determined by "Turkiye Klinikleri" and it is accessible on-line on http://www.turkiyeklinikleri.com domain name and/or subdomains connected to the domain name.

2.2. USER: A natural person or a legal identity accessing to the "SITE" through online settings.

2.3. LINK: A link enabling to access to another website through the "SITE", the files, the context or through another website to the "SITE", the files and the context.

2.4. CONTEXT: Any visual, literary and auditory images published in the "Turkiye Klinikleri", "SITE" and/or any website or any accessible information, file, picture, number/figures, price, etc.

2.5. "USER CONTRACT": An electronically signed contract between a natural or a legal identity benefiting from special services "Turkiye Klinikleri" will provide and "Turkiye Klinikleri".

3. SCOPE OF THE SERVICES

3.1. "Turkiye Klinikleri" is completely free to determine the scope and quality of the services via the "SITE".

3.2. To benefit the services of "Turkiye Klinikleri" "SITE", the "USER" must deliver the features that will be specified by "Turkiye Klinikleri". "Turkiye Klinikleri" may change this necessity any time single-sided.

3.3. Not for a limited number, the services "Turkiye Klinikleri" will provide through the "SITE" for a certain price or for free are;

- Providing scientific articles, books and informative publications for health industry.

- Providing structural, statistical and editorial support to article preparation stage for scientific journals.

4. GENERAL PROVISIONS

4.1. "Turkiye Klinikleri" is completely free to determine which of the services and contents provided in the "SITE" will be charged.

4.2. People benefiting from the services provided by "Turkiye Klinikleri" and using the website can use the "SITE" only according to the law and only for personal reasons. Users have the criminal and civil liability for every process and action they take in the "SITE". Every USER agrees, declares and undertakes that they will not proceed by any function or action infringement of rights of "Turkiye Klinikleri"s and/or other third parties', they are the exclusive right holder on usage, processing, storage, made public and revealing any written, visual or auditory information reported to Turkiye Klinikleri" and/or "SITE" to the third parties. "USER" agrees and undertakes that s/he will not duplicate, copy, distribute, process, the pictures, text, visual and auditory images, video clips, files, databases, catalogs and lists within the "SITE", s/he will not be using these actions or with other ways to compete with "Turkiye Klinikleri", directly or indirectly.

4.3. The services provided and the context published within the "SITE" by third parties is not under the responsibility of "Turkiye Klinikleri", institutions collaborated with "Turkiye Klinikleri", "Turkiye Klinikleri" employee and directors, "Turkiye Klinikleri" authorized salespeople. Commitment to accuracy and legality of the published information, context, visual and auditory images provided by any third party are under the full responsibility of the third party. "Turkiye Klinikleri" does not promise and guarantee the safety, accuracy and legality of the services and context provided by a third party.

4.4. "USER"s cannot act against "Turkiye Klinikleri", other "USER"s and third parties by using the "SITE". "Turkiye Klinikleri" has no direct and/or indirect responsibility for any damage a third party suffered or will suffer regarding "USER"s actions on the "SITE" against the rules of the hereby "Terms of Use" and the law.

4.5. "USER"s accept and undertake that the information and context they provided to the "SITE" are accurate and legal. "Turkiye Klinikleri" is not liable and responsible for promising and guaranteeing the verification of the information and context transmitted to "Turkiye Klinikleri" by the "USER"s, or uploaded, changed and provided through the "SITE" by them and whether these information are safe, accurate and legal.

4.6. "USER"s agree and undertake that they will not perform any action leading to unfair competition, weakening the personal and commercial credit of "Turkiye Klinikleri" and a third party,  encroaching and attacking on personal rights within the "SITE" in accordance with the Turkish Commercial Code Law.

4.7. "Turkiye Klinikleri" reserves the right to change the services and the context within the "SITE"  anytime. "Turkiye Klinikleri" may use this right without any notification and timelessly. "USER"s have to make the changes and/or corrections "Turkiye Klinikleri" required immediately. Any changes and/or corrections that are required by "Turkiye Klinikleri", may be made by "Turkiye Klinikleri" when needed. Any harm, criminal and civil liability resulted or will result from changes and/or corrections required by "Turkiye Klinikleri" and were not made on time by the "USER"s belongs completely to the users.

4.8. "Turkiye Klinikleri" may give links through the "SITE" to other websites and/or "CONTEXT"s and/or folders that are outside of their control and owned and run by third parties. These links are provided for ease of reference only and do not hold qualification for support the respective web SITE or the admin or declaration or guarantee for the information inside. "Turkiye Klinikleri" does not hold any responsibility over the web-sites connected through the links on the "SITE", folders and context, the services or products on the websites provided through these links or their context.

4.9. "Turkiye Klinikleri" may use the information provided to them by the "USERS" through the "SITE" in line with the terms of the "PRIVACY POLICY" and "USER CONTRACT". It may process the information or classify and save them on a database. "Turkiye Klinikleri" may also use the USER's or visitor's identity, address, e-mail address, phone number, IP number, which sections of the "SITE" they visited, domain type, browser type, date and time information to provide statistical evaluation and customized services.

5. PROPRIETARY RIGHTS

5.1. The information accessed through this "SITE" or provided by the users legally and all the elements (including but not limited to design, text, image, html code and other codes) of the "SITE" (all of them will be called as studies tied to "Turkiye Klinikleri"s copyrights) belongs to "Turkiye Klinikleri". Users do not have the right to resell, process, share, distribute, display or give someone permission to access or to use the "Turkiye Klinikleri" services, "Turkiye Klinikleri" information and the products under copyright protection by "Turkiye Klinikleri". Within hereby "Terms of Use" unless explicitly permitted by "Turkiye Klinikleri" nobody can reproduce, process, distribute or produce or prepare any study from those under "Turkiye Klinikleri" copyright protection.

5.2. Within hereby "Terms of Use", "Turkiye Klinikleri" reserves the rights for "Turkiye Klinikleri" services, "Turkiye Klinikleri" information, the products associated with "Turkiye Klinikleri" copyrights, "Turkiye Klinikleri" trademarks, "Turkiye Klinikleri" trade looks or its all rights for other entity and information it has through this website unless it is explicitly authorized by "Turkiye Klinikleri".

6. CHANGES IN THE TERMS OF USE

"Turkiye Klinikleri" in its sole discretion may change the hereby "Terms of Use" anytime announcing within the "SITE". The changed terms of the hereby "Terms of Use" will become valid when they are announced. Hereby "Terms of Use" cannot be changed by unilateral declarations of users.

7. FORCE MAJEURE

"Turkiye Klinikleri" is not responsible for executing late or never of this hereby "Terms of Use", privacy policy and "USER Contract" in any situation legally taken into account as force majeure. Being late or failure of performance or non-defaulting of this and similar cases like this will not be the case from the viewpoint of "Turkiye Klinikleri", and "Turkiye Klinikleri" will not have any damage liability for these situations. "Force majeure" term will be regarded as outside of the concerned party's reasonable control and any situation that "Turkiye Klinikleri" cannot prevent even though it shows due diligence. Also, force majeure situations include but not limited to natural disasters, rebellion, war, strike, communication problems, infrastructure and internet failure, power cut and bad weather conditions.

8. LAW AND AUTHORISATION TO FOLLOW

Turkish Law will be applied in practicing, interpreting the hereby "Terms of Use" and managing the emerging legal relationships within this "Terms of Use" in case of finding element of foreignness, except for the rules of Turkish conflict of laws. Ankara Courts and Enforcement Offices are entitled in any controversy happened or may happen due to hereby contract.

9. CLOSING AND AGREEMENT

Hereby "Terms of Use" come into force when announced in the "SITE" by "Turkiye Klinikleri". The users are regarded to agree to hereby contract terms by using the "SITE". "Turkiye Klinikleri" may change the contract terms and the changes will be come into force by specifying the version number and the date of change on time it is published in the "SITE".

 

30.03.2014

Privacy Policy

We recommend you to read the terms of use below before you visit our website. In case you agree these terms, following our rules will be to your favor. Please read our Terms of Use thoroughly.

www.turkiyeklinikleri.com website belongs to Ortadoğu Advertisement Presentation Publishing Tourism Education Architecture Industry and Trade Inc. and is designed in order to inform physicians in the field of health

www.turkiyeklinikleri.com cannot reach to user’s identity, address, service providers or other information. The users may send this information to the website through forms if they would like to. However, www.turkiyeklinikleri.com may collect your hardware and software information. The information consists of your IP address, browser type, operating system, domain name, access time, and related websites. www.turkiyeklinikleri.com cannot sell the provided user information (your name, e-mail address, home and work address, phone number) to the third parties, publish it publicly, or keep it in the website. Gathered information has a directing feature to be a source for the website’s visitor profile, reporting and promotion of the services.

www.turkiyeklinikleri.com uses the taken information:

-To enhance, improve and maintain the quality of the website

-To generate visitor’s profile and statistical data

-To determine the tendency of the visitors on using our website

-To send print publications/correspondences

-To send press releases or notifications through e-mail

-To generate a list for an event or competition

By using www.turkiyeklinikleri.com you are considered to agree that;

-Ortadoğu Advertisement Presentation Publishing Tourism Education Architecture Industry and Trade Inc. cannot be hold responsible for any user’s illegal and immoral behavior,

-Terms of use may change from time to time,

-It is not responsible for other websites’ contents it cannot control or the harms they may cause although it uses the connection they provided.

Ortadoğu Advertisement Presentation Publishing Tourism Education Architecture Industry and Trade Inc. may block the website to users in the following events:

-Information with wrong, incomplete, deceiving or immoral expressions is recorded to the website,

-Proclamation, advertisement, announcement, libelous expressions are used against natural person or legal identity,

-During various attacks to the website,

-Disruption of the website because of a virus.

Written, visual and audible materials of the website, including the code and the software are under protection by legal legislation.

Without the written consent of Ortadoğu Advertisement Presentation Publishing Tourism Education Architecture Industry and Trade Inc. the information on the website cannot be downloaded, changed, reproduced, copied, republished, posted or distributed.

All rights of the software and the design of the website belong to Ortadoğu Advertisement Presentation Publishing Tourism Education Architecture Industry and Trade Inc.

Ortadoğu Advertisement Presentation Publishing Tourism Education Architecture Industry and Trade Inc. will be pleased to hear your comments about our terms of use. Please share the subjects you think may enrich our website or if there is any problem regarding our website.

info@turkiyeklinikleri.com