A Comparative Approach To Web Evaluation And Website Evaluation Methods
Abstract
There is still a lack of an engineering approach for building Web systems, and the field of measuring the Web is not yet mature. In particular, there is an uncertainty in the selection of evaluation methods, and there are risks of standardizing inadequate evaluation practices. It is important to know whether we are evaluating the Web or specific website(s). We need a new categorization system, a different focus on evaluation methods, and an in-depth analysis that reveals the strengths and weaknesses of each method. As a contribution to the field of Web evaluation, this study proposes a novel approach to view and select evaluation methods based on the purpose and platforms of the evaluation. It has been shown that the choice of the appropriate evaluation method(s) depends greatly on the purpose of the evaluation.
Full Text:
PDFReferences
Abras, C., Maloney-Krichmar, D., & Preece, J. (2004). User-Centered Design. Bainbridge, W. Encyclopedia of Human-Computer Interaction. Thousand Oaks: Sage Publications, 37(4), 445-56.
Ahmad, R., Li, Z., & Azam, F. (2005). Web Engineering: A New Emerging Discipline. IEEE 2005 International Conference on Emerging Technologies. September 17-18, Islamabad.
Al-Juboori, A. F. M. A., Na, Y., & Ko, F. (2011). Web Site Evaluation: Trends and Existing Approaches. In Networked Computing (INC), 2011 The 7th International Conference, IEEE, 155-160.
Aminpour, F., Kabiri, P., Otroj, Z., & Keshtkar, A. (2009). Webometric Analysis of Iranian Universities of Medical Sciences. Scientometrics, 80 (1), 253–264.
Ataloglou, M., & Economides, A. (2009). Evaluating European Ministries' Websites. International Journal of Public Information Systems, 5(3), 147–177.
Berntzen, L., & Olsen, M. (2009). Benchmarking E-government- A Comparative Review of Three International Benchmarking Studies. In Digital Society, 2009. ICDS'09. Third International Conference on IEEE, 77-82.
Björneborn, L. (2004). Small-World Link Structures across an Academic Web Space: A Library and Information Science Approach. Royal School of Library and Information Science, Denmark. Retrieved from
http://vip.db.dk/lb/phd/phd-thesis.pdf
Boell, S., Wilson, C., & Cole, F. (2008). A Webometric Analysis of Australian Universities Using Staff and Size Dependent Web Impact Factors (WIF). University of New South Wales, School of Information Systems, Technology and Management (SISTM), Sydney, Australia
Brajnik, G. (2004a). Comparing Accessibility Evaluation Tools: A Method for Tool Effectiveness. Universal Access in the Information Society, 3(3-4), Springer Verlag, 252-263
Brajnik, G. (2004b). Using Automatic Tools in Accessibility and Usability Assurance. 8th International ERCIM UI4ALL Workshop, June 2004, Vienna, Austria. Springer, Berlin, 219-234
Brajnik, G. (2008). Beyond Conformance: The Role of Accessibility Evaluation Methods. Keynote paper, 2nd International Workshop on Web Usability and Accessibility IWWUA08, September, 2008, Auckland, New Zealand. Retrieved from http://www.cast.org/learningtools/Bobby/index.html
Calero, C., Ruiz, J., & Piattini, M. (2005). Classifying Web Metrics Using the Web Quality Model. Online Information Review, Emerald Group, 29 (3), 227-248
Chiou, W. C., Lin, C. C., & Perng, C. (2010). A Strategic Framework for Website Evaluation based on a Review of the Literature from 1995–2006. Information & Management, 47(5), 282-290.
Cho, J., & Adams, R. (2005). Page Quality: In Search of an Unbiased Web Ranking. In Proceedings of the 2005 ACM SIGMOD conference, Baltimore, Maryland, 551-562
Cybermetrics Lab. (2010). Webometrics Ranking of World Universities. Retrieved from
http://www.webometrics.info/
Deshpande, Y., Murugesan, S., Ginige A., Hansen, S., Schwbe, D., Gaedke, M., & White, B. (2002). Web Engineering. Journal of Web Engineering, Rinton Press, 1(1), 003-017.
Dhyani, D., Ng, W., & Bhowmick, S. (2002). A Survey of Web Metrics. Nanyang Technological University. ACM Computing Surveys, 34(4), 469–503.
Dingli, A., & Mifsud, J. (2011). USEFul: A Framework to Mainstream Web Site Usability through Automated Evaluation. International Journal of Human Computer Interaction (IJHCI), 2(1), 10
Dominic, P., & Jati, H. (2010). Evaluation Method of Malaysian University Website: Quality Website Using Hybrid Method. In Information Technology (ITSim), 2010 International Symposium, IEEE, 1, 1-6
Dominic, P., Jati, H., & Kannabiran, G. (2010). Performance Evaluation on Quality of Asian E-government Websites - an AHP Approach. International Journal of Business Information Systems, 6(2), 219-239.
Fang, W. (2007). Using Google Analytics for Improving Library Website Content and Design: A Case Study. Library Philosophy and Practice 2007, 1-17
Fernandez, A., Insfran, E., & Abrahão, S. (2011). Usability Evaluation Methods for the Web: A Systematic Mapping Study. Information and Software Technology, 53(8), 789-817.
Folmer, E., Bosch, J. (2004). Architecting for Usability: A Survey. Journal of Systems and Software, 2004, 70(1), 61–78. Retrieved from http://dissertations.ub.rug.nl/FILES/faculties/science/2005/e.folmer/c2.pdf
Hasan, L. (2009). Usability Evaluation Framework for E-commerce Websites in Developing Countries. A Doctoral dissertation. Loughborough University
Hasan, L., Morris, A., & Probets, S. (2009). Using Google Analytics to Evaluate the Usability of E-commerce Sites. In Human Centered Design, Springer Berlin Heidelberg, 697–706
Holmberg, K., & Thelwall, M. (2009). Local Government Web Sites in Finland: A Geographic and Webometric Analysis. Scientometrics, 79(1), 157–169.
Hong, I. (2007). A Survey of Web Site Success Metrics Used by Internet-dependent Organizations in Korea. Internet Research, Emerald Group, 17(3), 272-290
Ivory, M. & Chevalier, A. (2002). A Study of Automated Web Site Evaluation Tools. University of Washington, Department of Computer Science2002
Ivory, M. Y., & Hearst, M. A. (2001). The State of the Art in Automating Usability Evaluation of User Interfaces. ACM Computing Surveys (CSUR), 33(4), 470-516.
Jalal, S., Biswas, S. & Mukhopadhyay, P. (2010). Web Impact Factor and Link Analysis of Selected Indian Universities. Annals of Library and Information Studies, 57, 109 – 121. Retrieved from
http://eprints.rclis.org/16164/1/Annals-57-2.pdf
Jeyshankar, R., & Babu, R. (2009). Websites of Universities in Tamil Nadu: A Webometric Study. Annals of Library and Information Studies, 56(2), 69-79. Retrieved from
http://nopr.niscair.res.in/bitstream/123456789/5939/1/ALIS%2056(2)%2069-79.pdf
Kaur, A., & Dani, D. (2013). The Web Navigability Structure of E-Banking in India. International Journal of Information Technology and Computer Science (IJITCS), 5(5), 29. Retrieved from
http://www.mecs-press.org/ijitcs/ijitcs-v5-n5/IJITCS-V5-N5-4.pdf
Kumar, S. Sangwan, S. (2011). Adapting the Software Engineering Process to Web Engineering Process. International Journal of Computing and Business Research, 2(1)
Lárusdóttir, M. (2009). Listen to Your Users: The Effect of Usability Evaluation on Software Development Practice. A Doctoral Dissertation, Department of Information Technology, UPPSALA University, Sweden
Li, X. (2003). A Review of the Development and Application of the Web Impact Factor. Online Information Review, Emerald Group, 27(6), 407-417. Retrieved from http://www.emeraldinsight.com/researchregister
Matera, M., Rizzo, F., Carughi, G. (2006). Web Usability: Principles and Evaluation Methods. Department of Electronic Information, Milano, Italy
Murugesan, S. (2008). Web Application Development: Challenges and the Role of Web Engineering. University of Western Sydney, Australia.
Nielsen, J. (1993). Usability Engineering. San Francisco, CA: Morgan Kaufmann
Nielsen, J. (2011). Top 10 Mistakes in Web Design. Retrieved from http://www.useit.com/alertbox/9605.html
Nielsen, J. (2012a). Thinking Aloud: The #1 Usability Tool. Retrieved from
http://www.nngroup.com/articles/thinking-aloud-the-1-usability-tool/
Nielsen, J. (2012b). Usability 101: Introduction to Usability. Retrieved from
http://www.nngroup.com/articles/usability-101-introduction-to-usability/
Nielsen, J. & Mack, R. L. (Eds.) (1994). Usability Inspection Methods. John Wiley & Sons, New York.
Noruzi, A. (2005). Web Impact Factors for Iranian Universities. Webology, 2(1), Retrieved from http://webology.ir/2005/v2n1/a11.html
Noruzi, A. (2006). The Web Impact Factor: A Critical Review. The Electronic Library, 24(4), 490-500.
Olsen, M., Nietzio, A., Snaprud, M., & Fardal, F. (2009). Benchmarking and Improving the Quality of Norwegian Municipality Web Sites. Automated Specification and Verification of Web Systems, 115
Palmer, J. (2002). Web Site Usability, Design, and Performance Metrics. Information Systems Research, 13(2), 151-167
Petricek, V., Escher, T., Cox, I., & Margetts, H. (2006). The Web Structure of E-Government - Developing a Methodology for Quantitative Evaluation. In Proceedings of the 15th international conference on World Wide Web, ACM, 669-678
Prom, C. (2007). Understanding On-line Archival Use through Web Analytics. ICA-SUV Seminar, Dundee, Scotland. Retrieved from http://www.library.uiuc.edu/archives/workpap/PromSUV2007.pdf
Scowen,G. (2007). Increased Website Popularity through Compliance with Usability Guidelines. A Doctoral Dissertation. Information Science, University of Otago, New Zealand
Shekofteh, M., Shahbodaghi,A., Sajjadi, S., & Jambarsang, S. (2010). Investigating Web Impact Factors of Type 1, Type 2 and Type 3 Medical Universities in Iran. Journal of Paramedical Sciences (JPS), 1(3).
Stolz, C., Viermetz, M., Skubacz, M., & Neuneier, R. (2005). Guidance Performance Indicator- Web Metrics for Information Driven Web Sites. IEEE/WIC/ACM International Conference on Web Intelligence 2005, 186–192
Stone, D., Jarrett, C., Wodroffe, M., & Minocha, S. (2005). User Interface Design and Evaluation. San Francisco, CA: Morgan Kaufmann
Thelwall, M., & Zuccala, A. (2008). A University-Centred European Union Link Analysis. Scientometrics, 75(3), 407–420.
Treiblmaier, H., & Pinterits, A. ( 2010). Developing Metrics for Web Sites. Journal of Computer Information Systems, 50(3).
Woolrych, A., Hornbæk, K., Frøkjær, E., & Cockton, G. (2011). Ingredients and Meals rather than Recipes: A Proposal for Research that does not treat Usability Evaluation Methods as Indivisible Wholes. International Journal of Human-Computer Interaction, 27(10), 940-970.
Refbacks
- There are currently no refbacks.