IEC 9126-4 for the

regard, in ISO / IEC 9126-4, there are 4 metrics used to measure, among other effectiveness metrics, productivity metrics, security metrics, and Satis...

0 downloads 1 Views 633KB Size
1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

ISSN 2301-6590

Analysis of Web-Education Based on ISO/IEC 9126-4 for the Measurement of Quality of Use Marzuki#1, Agus Sukoco#2, Ahmad Cucus#3, Maria ShusantiFebrianti#4 Lisa Devilia#5 #1,2,3,4,5

Faculty of Computer Science, Bandar Lampung University Jl. ZA. PagarAlam No. 26, LabuhanRatu, Bandar Lampung 35142, Lampung, Indonesia 1

[email protected] [email protected] 3 [email protected] 4 [email protected] 2

Abstract— FIK UBL Website is the website of the Faculty of Computer Science education at the University of Bandar Lampung.Domain name from FIK website UBL is www.fik.ubl.ac.id.FIK website is a subdomain of the UBL website www.ubl.ac.id.The website uses ac.id as Country Code Top level domains, domain primarily UBL, and Third-level domain is the FIK.UBL has FIK Website Hosting Server at Nusanet provider.In terms of design websites using CMS jg FIK UBL, the CMS Lokomedia.Scientific Writing will specifically focus on the analysis of UBL-based FIK website ISO / IEC 9126-4 for the use of quality measurement.In this regard, in ISO / IEC 9126-4, there are 4 metrics used to measure, among other effectiveness metrics, productivity metrics, security metrics, and Satisfaction Metrics.More specific explanation will describe in Chapter IV the author of scientific writing is about the quality of the use of UBL FIK website.

Keywords—Website,

ISO

/

IEC

9126,

service is an indicator of success in improving the image of college campuses in the Internet world. Education website is a website that will be examined is FIK UBL.At the University Belfast, School of Computer Science is the only faculty who have a different faculty website of UBL campus website.For that reason, building a website requires the right information and reliable.Thus, the quality of the use of UBL FIK campus website can be evaluated based on ISO / IEC 9126-4 Quality Metrics Use. ISO (InternationalOrganization for Standardization)and IEC (InternationalElectrotechnical Commission)is a standardization organization in the world.ISO 9126Software engineering - Product Qualityis an international standard for evaluating the quality of the software. The international standardisdivided into 4 parts, namely the quality model (ISO / IEC 9126-1), External metrics (ISO / IEC 9126-2), Internal metrics (ISO / IEC 9126-3), and Use of Quality Metrics (ISO / IEC 9126-4).section that will be examined for the website, ISO / IEC9126-4.ISO / IEC 9126-4 Quality Metricsis theuse ofInternational Standards published by ISO and IEC to software measurement of quality of use.

Metrics,

Effectiveness Metrics, Productivity Metrics.

1. INTRODUCTION Today the world has known a technology called the internet.With this internet everyone can communicate with other people who are in different parts of the world.Internet has a variety of information services, one of which is presented through the Website or the World Wide Web (WWW).Website is one of the Internet resources of the fastest growing and popular.Web information is distributed through hypertext approach, which allows an approach to be a reference text for other open documents.Given this hypertext one can obtain information by leaping from one document into another document (Kadir: 2003, 4). All information in this Internet medium is the Website. Seeing as the rapid development of the website right now, should be able to choose which websites are qualified and able to meet their information needs. Education website to provide information needed by students at the University. Education at the university website contains information about the campus.Campus so that students can find out information simply by accessing the website only.Quality of service in the dissemination of information in the campus internet website has become a very important requirement, because it affects the level of student satisfaction and the outside community.Ultimately improving the quality of

2.

MODEL, ANALYSIS, DESIGN, AND IMPLEMENTATION MODEL

2.1 Research Model In the study will measure the UBL website based FIK StandardISO / IEC9126-4Quality Metrics Use.So that the research conducted to provide answers to questions about the quality / quality use of UBL FIK campus website.If these aspects in a website that quality criteria are met, then a valuable website to meet the needs of the information has been obtained. ISO / IEC 9126-4 Quality Use of Metrics used tomeasure the extent to which a product meets the requirements specified users to achieve specific goals.Metrics is a unit for measuring the software.In the ISO / IEC 9126-4 there were metrics of effectiveness,safety,productivity, and satisfaction in a specified context of use of quality metrics. Quality in use is not only dependent on software products, but also on the specific context in which the product is being used.Context of use is determined by a factor of user,taskfactorsand physical and social environmental factors.Quality used is assessed by observing representative

46

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

users carry out representative tasks in a realistic context of use. In the ISO / IEC 9126-4 there were four metrics, namely: 1) Effectiveness Effectiveness metrics measure the accuracy and completeness with the goal could be achieved. 2) Produvtivity Productivity measures related to the level of effectiveness achieved for the expenditure of resources.Relevant resources may include mental or physical effort, time, materials or financial cost.. 3) Safety Kuran verifier security risks associated with the operation of software products from time to time, conditions of useand context of use.Safety can be analyzed in terms of operational safety and contingencysafety.Operational safety is the ability of software to meet user requirements during normal operation without jeopardizing other resources and the environment.Safety is the ability of contingencysoftware to operate outside the normal operations and divert resources to prevent escalationrisk. 4) Satisfaction Satisfaction measures the extent to which users are free from discomfort and their attitude towardsuse of the product.Satisfaction can be defined and measured according to the subjective judgment onscale such as: love forproducts, satisfaction with the use of the product, acceptance of workload when performingdifferent ugas t, or the extent to which a certain quality in use objectives (such as productivity or ability to learn)have been met.

ISSN 2301-6590

a student / student and a person FIK UBL Developer of this website. The sampling method used in this study is purposive sampling technique, consists of two selection methods, namely: the selection of samples based on quotas, while the study used a method / technique is based on considerations of sample selection (judgment sampling), the selection is not random that the information obtained by using certain considerations which are generally adapted to the purpose of this study and formulation of the problem. 2. Sample Selection Methods Data collection methods used in this study, namely: 1) Observation Observation is the ability to use his observations through the eyes of the senses work and assisted with other senses.According to Patton (in Poerwandari 1998) describe the purpose of observation is a study setting, the activities that took place, the people involved in the activity, and the meaning of events in view of their perspective is seen in the observed events. 2) Questionnaire The questionnaire was given written questions to the respondent to answer.Respondents could provide the answer by checking one or more answers have been provided, or by writing the answer (Kountur, 2007: 189).Authors use this questionnaire as a data collection tool developed by the main grid predetermined. 3. Sample Selection Methods The research variables used in this study contained within the ISO 9126-4 on the use of quality measures, namely: 1. Effectiveness Metrics Effectiveness metrics to assess whether the tasks performed by users to achieve specified goals with accuracy and comprehensiveness in the particular context of use. Effectiveness metrics are divided into: a. Effectiveness Task Subvariabel is used to determine the proportion of the purpose of the task is accomplished correctly.In this subvariabelcalculation using the method of data elements are:

2.2 Analysis of Data 1.Sample Selection Methods Population is the complete set of entities that can be made up of people, events, or objects, which have some common characteristics (Wibisono, 2003: 40).Sample is part of the population.Samples consisted of a few selected members of the population (Wibisono, 2003: 41).Samples can also be defined as a part drawn from the population (Istijanto, 2009: 113).As a result, the sample is always a smaller part of the population.Because the sample is used to represent the population studied, the sample tends to be used for research seeking to conclude the generalization of its findings. In this study, the thresholds in the population of this study is based on ISO / IEC 9126-4 is: 1. Users is aindividuals or organizations that use the system to perform certain functions. 2. Develop is theindividual or organizationwho dope development of activities,includingrequirements analysis, design,and testingduringthe cyclesoftware life. The study populationof the user is a student / faculty student university computer Bandar Lampung is still active some 121 people, and a developer is the person who designed the website FIK UBL.Then, the sample size of this study were 11 people, consisting of 10 people a user who is

M1 = | 1-ΣA i | 1 Description: Ai = proportional value of the missing or faulty components in the output task. b. Task Completion Subvariabel is used to determine the proportion of tasks completed.In this subvariabelcalculation using the method of data elements are: X=A/B

47

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

Description: A = number of completed tasks B = total number of tasks executed c. Frequency Error Subvariabel is used to determine the frequency of errors found.In this subvariabelcalculation using the method of data elements are:

e.

the search Tb = time task Relative User Efficiency Subvariabel is used to determine how efficiently the user compared to the expert.In this subvariabelcalculation using the method of data elements are: Relative User Efficiency X = A / B

X=A/T

Description: A = Efficiency of Common User Tasks Task B = Efficiency Expert Users

Description: A = the number of errors made by users T = time or the number of tasks

2.4 Security Metrics Security metrics to assess the level of risk of harm to people,software,business property,or the environment in a particular context is used.These include health and safety of both users and those affected by the use,as well asphysical or economic consequences are not desirable. Security metricsare divided into the following: a. Health and Safety Users Subvariabel is used to determine the health problems of the user while using the website. In this subvariabelcalculation using the method of data elements are:

2.3 Productivity Metrics Productivity metrics to assess the user's resource consumption in relation to the effectivenessachieved intheparticular contextofuse.The most common resource is the time to complete the task, although other relevant resources could include business users, the use of materials or financial cost. Productivity metrics are divided into the following: a. Task time Subvariabel is used to determine the time needed to complete the task.In this subvariabelcalculation using the method of data elements are:

X=1-A/B

X = Ta

Description: A = the number of users who report health problems B = total number of users b. Safety of people affected by the use of the system Subvariabel is used to determine the incidence of air hazard to persons affected when using the system. In this subvariabelcalculation using the method of data elements are:

Description: Ta = Time Tasks b. Efficiency Task Subvariabel is used to determine how efficient use of the website.In this subvariabelcalculation using the method of data elements are: X = M1 / T

c.

ISSN 2301-6590

X=1-A/B

Description: M1 = The effectiveness of task T = Time task Economic Productivity Subvariabel is used to determine cost effective in use.In this subvariabelcalculation using the method of data elements are:

Description: A = the number of people affected by hazards B = total number of people potentially affected by the system c. Economic Damage Subvariabel is used to determine the economic damage. In this subvariabelcalculation using the method of data elements are:

X = M1 / C Description: M1 = Effectiveness Task C = Total BiayaTugas d. Proportion of Productive Subvariabel is used to determine the proportion of time when users productive action.In this subvariabelcalculation using the method of data elements are:

X=1-A/B Description: A = number of occurrences of economic damage B = total number of use d. Damage to software Subvariabel is used to determine the occurrence of software defects. In this subvariabelcalculation using the method of data elements are:

X = Ta / Tb

X=1-A/B

Description: Ta = time = time productive tasks - time help - the error -

Description: A = number of occurrences of software malfunction

48

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

B = total number of situations of use 2.5 Satisfaction Metrics User satisfaction metrics to assess attitudes toward the use of certain products in the context of use.Satisfaction is influenced by user perceptions about the nature of software products (as measured with an external metric) on the efficiency, productivity, and safety in use. Satisfaction metricsare divided into the following: a. Satisfaction Scale Subvariabel is used to determine the satisfaction of the user. In this subvariabelcalculation using the method of data elements are:

TABLE1MEASUREMENT SCALE OBSERVATIONS Scale for the FREQUENCY 1 - Never Happen 2 - Once there 3 - A month ~ year 4 - A week ~ <1 month 5 - Continuous Every Day PUBLIC IMPACT scale 1 - There is no public impact 2 - Minor local, there is no interest of the press 3 - Minor local concern, local news 4 - National News, reputational risk 5 - Reputation destroyed

X=A/B Description: A = scale psychometric questionnaires produce B = the average population b. Satisfaction Questionnaire Subvariabel is used to determine the user satisfaction of the features of the software.In this subvariabelcalculation using the method of data elements are: X = Σ(A i)/ n

c.

ISSN 2301-6590

Description: A i = responses to questions n = number of responses Wisdom In Use Subvariabel is used to determine the proportion of potential users choose to use the system.In this subvariabelcalculation using the method of data elements are:

HEALTH IMPACT scale 1 - There is no pain, Loss Time Accident = 0 2 - Hospital without treatment, the LTA = <2 days 3 - Pain with care, LTA = 2 days

X=A/B Description: A = the amount of use of the software used B = the number of users expected to use the software.

2.6 Measurement Scale

~ one week 4 - moderately severe pain, LTA <1 month 5 - Very ill, LTA> 1 month

In the study has two types of scales.These scales are scales for the measurement of the questionnaire and observation.The questionnaire study using a scale thatcan be expressed using an ordinal scale is 1-9.Scale was translated into a level that is, a low level 1-3, 4-6 to Medium level, and a High Level 7-9.While the observation of this study using a scale for frequency, Public Impact, Business Impact, Impact of Health, and the Impact of Recovery in Table 1.Measurement scale of observation.

BUSINESS IMPACT scale 1 - Cost can be ignored 2 - Cost <0.1% profit 3 - Cost ≥ 0.1%> 10% profit 4 - 10% ≥ Cost > 100% profit, temporary closure 5 - Cost > profit / closing RECOVERY IMPACT scale 1 - Total Recovery 1 month 2 - Total Restoration 1 year 3 - Total Recovery <5 years 4 - Total Recovery> 5 years 5 - Impact can not be restored

With the observation table can use the Risk Matrix that can produce the level of risk as shown in Table 2.Risk Level Observation.

49

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science FREQUENCY Every Day (5)

ISSN 2301-6590

2. Question "how many time you run a website FIK UBL?"

LEVEL M

M

H

H

H

M

M

M

H

H

(3)

L

M

M

H

H

To occur (2)

L

L

M

M

H

percentage of user response

Once a week (4) Once in 2 years

It Never

25%

Happened

L

L

M

M

Medium High

Catas

ficant

Minor

Moderate

Major

Trophic

(1)

(2)

(3)

(4)

(5)

Fig. 2.Percentage Graph User Response Questionnaire Question 2

Based on Fig. 2, shows 58.33% said Low, Medium 25% answered, and 16.67% said High.Therefore, the percentage level through the most answered by the respondents is low.

III. DATA ANALYSIS OF QUESTIONNAIRE RESULTS The research will be conducted by distributing questionnaires sample of 12 people.This questionnaire will examine the effectiveness metrics, Productivity, and Satisfaction of UBL FIK website a. Effectiveness metrics Inside there are 4 questions Effectiveness Metrics.Each question has a level and then compared the results of the statistics will get the final level for effectiveness metrics. 1. The question "is there any component or feature of the website that is not appropriate UBL FIK while running?"

3. Question "How many times FIK website UBL completed their duties?"

percentage of user response 0%

percentage of user response

16,67%

Low 83,33%

Low 33,33% 41,67% 25%

58,33%

M

Insigni

IMPACT

Low

16,67%

Medium High

Fig 3.Grafik image User Response Questionnaire Question 3

Based on Fig. 3, shows 83.33% said Low, no respondents who answered at the Medium level, and 16.67% said High.Therefore, the percentage level through the most answered by the respondents is low.

Medium High

Fig. 1.Percentage Graph User Response Questionnaire Question 1

Based on Fig. 1, shows 41.67% said Low, Medium 25% answered, and 33.33% said High.Therefore, the percentage level through the most answered by the respondents is low.

50

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

4. Question "how many times you make a mistake when accessing the website FIK UBL?"

ISSN 2301-6590

2. Question"whether you are a current cost to access the website FIK UBL?"

percentage of user response

percentage of user response 8,33% 8,33%

16,67%

Low

16,67%

Low

Medium 66,66%

Medium

83,34%

High

High

Fig.6 Percentage Response Graphic User Questionnaire Question 6

Fig. 4.Percentage Graph User Response Questionnaire Question 4

Based on Fig. 4.8, shows 66.66% said Low, Medium 16.67% answered, and 16.67% said High.Therefore, the percentage level through the most answered by the respondents is low. Metrics on the effectiveness of the four questions contained therein, all result in low levels.Therefore, the end result of the effectiveness of metrics is Low Level.

Based on Fig. 4.10, shows 83.34% said Low, Medium 8.33% answered, and 8.33% said High.Therefore, the percentage level through the most answered by the respondents is low.

b. Productivity Metrics Productivity metrics contained within the 3 questions. Each question has a level and then compared the results of the statistics will get the final level for productivity metrics. 1. Question "How long FIK UBL website to complete the task?"

percentage of user response

3. Question "whether you know about a website?"

33,33% 41,67%

Low Medium

percentage of user response 16,67% 16,67%

25%

Fig.7 Percentage Response Graphic User Questionnaire Question 7

Low Based on Fig. 4.11, shows 58.33% said Low, Medium 41.67% answered, and no respondents who answered at the High level.Therefore, the percentage level through the most answered by the respondents is low. On productivity metrics from three questions contained in it, one question has the Medium and 2 Low-level questions produce.Therefore, the final results of the Level Low productivity metrics.

Medium 66,66%

High

High

Fig.5 Percentage Graph User Response Questionnaire Question 5

Based on Fig. 4.9, shows 16.67% said Low, Medium 66.66% answered, and 16.67% said High.Therefore, the percentage level through the most answered by the respondents is Medium.

c. Satisfaction metrics Satisfaction metrics contained in the first question that the level of questions is the result of the final level for satisfaction metrics. The question "Are you satisfied with the components or features of the website FIK UBL?"

51

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

3.3 Merging Data Analysis of Questionnaire Results and Observations After analyzing the results of questionnaires and observations, the results were combined to produce measurement results FIK website UBL based on ISO / IEC 9126-4 Quality Metrics Use.

percentage of user response 8,33%

33,34%

TABLE 3USE OF WEBSITE QUALITY MEASUREMENT RESULTS FIK UBL

Low Medium

58%

Quality Use of

High

Characteristics

Based on Fig. 4.12, shows 33.34% said Low, Medium 58.33% answered, and 8.33% said High.Therefore, the percentage level through the most answered by the respondents is low.On a question of productivity metrics contained in the question has the Medium.Therefore, the end result of productivity metrics is the Medium Level.

Satisfaction

Effectiveness

L

Productivity

L

Satisfaction

M

3.2 Data Analysis of Observations After the observation at the Security metrics, produced the same final level as the final level in the questionnaire, namely the level of Low, Medium, and High.The results of each level of risk inherent in the observation of the security metrics yield percentage of 25% Low risk, Medium risk of 62.5%, and high risk as much as 12.5%.Therefore, security metrics have the final level is Medium, which has a mediumrisk of 62.5%.

FIK UBL Website is the website of the Faculty of Computer Science education at the University of Bandar Lampung.Domain name from FIK website UBL is www.fik.ubl.ac.id.FIK website is a subdomain of the UBL website www.ubl.ac.id.The website uses ac.id as Country Code Top level domains, domain primarily UBL, and Thirdlevel domain is the FIK.UBL has FIK Website Hosting Server at Nusanet provider.In terms of design websites using CMS jg FIK UBL, the CMS Lokomedia.Here are some of the UBL FIK .

12,5% Low

62,5%

M

IV. RESULT

Persentase Respon User

25%

L L M

3.4 Implications of Research Implications of Research is planning a study in the future so as to provide a basis for further research.This study has implications for the 3 (three) main aspects, namely: the managerial aspects, aspects of the system and further research aspects. a. Managerial Aspects With a faculty of management research is expected to utilize the results of this research by improving the quality of use of website based on ISO / IEC 9126-4 in order to improve the quality of use of the website. b. Aspects of the system The quality of UBL FIK website should be improved, so as to provide convenience to the user or student who uses this website UBL. c. Aspects of Advanced Studies In the next study is expected to examine UBL FIK website based on ISO / IEC other series.So the quality of UBL FIK website will get better and are in accordance with ISO Standards.

TABLE 2. LEVEL ANALYSIS OF QUESTIONNAIRE RESULTS Level

Scale High/Medium/Low

Effectiveness Productivity Security

Fig.8 Percentage Response Graphic User Questionnaire Question 8

Metriks

ISSN 2301-6590

Medium High

Fig.9 Graph of Percentage of Observations

52

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

ISSN 2301-6590

have a variety of activities on the system running.Respondent is an actor who portrayed the Use Case Diagram

Fig.10Screenshot of Website FIK-1 UBL

Fig. 11Screenshot of Website FIK-2 UBL

Fig.13Use Case Diagram

V.

CONCLUSION

After analyzing the results of questionnaires and observations, the results were combined and compared to the levels required in the standard ISO / IEC 9126-4. Table 4.Research results based on UBL Website FIK ISO 9126-4 Quality Use of Current Metriks Results Levels required Research Not Efektivity L H Available Not Produktivity L H Available Not Security M L Available Satisfaction M M Appropriate

Fig. 12Screenshot of Website FIK-2 UBL

Data obtained from the results of this study is qualitative data.Qualitative data was obtained from the questionnaire responses from the user and developer respondents in this study UBL FIK website and the observations made by the author.The research was carried out to respondents who

53

1st International Conference on Engineering and Technology Development (ICETD 2012) Universitas Bandar Lampung Faculty of Engineering and Faculty of Computer Science

Based on the overall study produced some important findings in the conclusions that can be formulated as follows:

1. The effectiveness of metrics in the study produced low levels, while the level required is high.So that the results of research on the state website FIK UBL Effectiveness Metrics are not in accordance with ISO / IEC 9126-4. 2. Productivity metrics in the study produced low levels, while the level required is high.So that the results of research on the state website FIK UBL Productivity Metrics are not in accordance with ISO / IEC 9126-4. 3. Security metrics in the study produces Medium level, whereas it takes is a Low Level.So that the results of research on the state website FIK UBL Productivity Metrics are not in accordance with ISO / IEC 9126-4. 4. Satisfaction Metrics in the study produce medium level, while the required level is Medium.So that the website states FIK Research Metrics Satisfaction UBL in accordance with ISO / IEC 9126-4. 5. 4 Metrics Standards of ISO / IEC 9126-4, only one standard metrics that correspond to ISO / IEC 9126-4 based on the use of quality measurement research FIK website. VI. RECOMMENDATION

1. 2.

As for recomendation that can be delivered by the author are: By looking at these results, UBL FIK website should be improved so as to meet the standards of ISO / IEC 91264. For the components of the website are not appropriate FIK UBL should be repaired so that the quality of use of the website better. REFERENCES

[1] 9126-4: Software Engineering – Software Product Quality - Part 4: Quality In Use Metrics. 2001. Canada: ISO/IEC [2] 9126-3: Software Engineering – Software engineering –Product quality – Part 3: Internal metrics. 2002. Canada: ISO/IEC. [3] 9126-2: Software Engineering – Software engineering –Product quality – Part 2 - External Metrics. 2001. Canada: ISO/IEC. [4] 9126-1: Software Engineering – Software engineering –Product quality – Part 1: Quality model. 2000. Canada: ISO/IEC. [5] Simarmata, Janner. 2007. RekayasaPerangkatlunak.Yogyakarta: PenerbitAndi. [6] Barnes, Stuart &Vidgen, Richard.WebQual: An Exploration of Web-site Quality.United Kingdom: School of Management, University of Bath. [7] Olsina, Luis & Rossi, Gustavo.2002. Measuring Web Application Quality with WebQEM. Argentina: La Pampa National University & La Plata National University [8] Barnes, Stuart &Vidgen, Richard. 2000. Assessing the quality of auction web sites. United Kingdom: School of Management, University of Bath. [9] Bevan, Nigel. 2000. Quality in use for all.

54

ISSN 2301-6590