The impact of knowledge management system quality on the usage continuity and recommendation intention

This study aimed to examine the influence of knowledge management system (KMS) quality on users’ continuance intention. The research model was developed by integrating the concept of DeLone and McLean’s information systems (IS) success model with the expectation confirmation model. To examine the developed model, a survey was conducted with 131 respondents from three companies that had implemented a KMS. The data were analyzed using the partial least square (PLS) method. The study demonstrated that both system quality and information/knowledge quality influence all the factors that drive the continuance intention regarding KMS usage, namely perceived usefulness, satisfaction, and trust. Moreover, satisfaction proved to have an impact on users’ recommendation intention concerning the KMS. Therefore, companies should improve the KMS quality in order to drive employees to continuously use the KMS and recommend it to others. Knowledge Management & E-Learning, 9(2), 200–224 201


Introduction
Knowledge management (KM) can be described as an effort to capture factually explicit information, information and tacit knowledge, or information stemming from employees that will help the organization to achieve its goals (Becerra-Fernandez & Sabherwal, 2010). Jennex (2005) defines KM as a process for selecting knowledge based on past decisions in order to assist in the decision-making process and thus improve the organization's effectiveness.
There are numerous factors that could encourage an organization to implement KM. According to Becerra-Fernandez and Sabherwal (2010), a high employee turnover rate within an organization is one of the most important reasons for implementing KM.
With KM, companies do not need to worry about the turnover rate, since the knowledge of former employees is captured by the KM process. Moreover, through effective KM, an organization can avoid repetitive work and mistakes (Farzaneh & Shamizanjani, 2014). Rapid market changes also encourage companies to implement KM. Organizations can use customer knowledge and identify patterns in the market to help in decision making.
The KM process can be supported by information technology (Becerra-Fernandez & Sabherwal, 2010;Maccoby, 2003;Wu & Wang, 2006) in the form of a knowledge management system (KMS) (Wu & Wang, 2006). A KMS can support the KM process in various ways, including making finding necessary information faster, integrating information into a comprehensive body of knowledge (Moos, Beimborn, Wagner, & Weitzel, 2011), providing an integrated repository to store all the organization's knowledge (Bera & Wand, 2009;Leung, Shamsub, Tsang, & Au, 2015), collaborating with other employees in a discussion (Abdelrahman, Papmichail, & French, 2011), and identifying an expert to ask about necessary information or knowledge (Wu & Wang, 2006). One of the main benefits of a KMS is the availability of relevant, accurate, and timely knowledge, which can be used in various forms so as to help companies and individuals effectively solve problems and make decisions (Tiwana & Bush, 2005). The decision maker can find the information stored in the company via the KMS and can thus work to increase the company's effectiveness and competitiveness (Tiwana & Bush, 2005).
According to Wu and Wang (2006), a KMS is a type of information system. Similar to other information systems, a KMS that is not adequately used by a company will not lead to any positive impacts (Sucahyo, Utari, Budi, Hidayanto, & Chahyati, 2016;Wu & Wang, 2006). Any type of information technology implemented by a company will only fulfill its promise if it is used continuously by employees (He & Wei, 2008). According to Li and Liu (2011), prior research has shown that a company's behavior after receiving an information system is a vital factor in supporting the company's efforts to compete in a competitive marketplace. The company needs to encourage its employees to continuously use the system so that the company is able to gain positive impacts (Li & Liu, 2011). Studies on continuous information system usage are therefore just as important as studies on the intention to use and information system acceptance (Kim, Hong, Min, & Lee, 2011;Li & Liu, 2011). Unfortunately, most prior studies only discussed the early stages of system usage . Relatively few studies have assessed the following stages (post-adoption stages) to determine users' behavior after they have used an information system, including KMSs. This research study aims to identify the factors that encourage users' willingness to continuously use a KMS. Research concerning KMS usage continuity is still rare (He & Wei, 2008). We use the expectation confirmation model (Bhattacherjee, 2001) because many studies have demonstrated its capacity to explain continuance usage behavior in relation to information systems. In addition, we integrate the model with DeLone and McLean's information systems (IS) success model (DeLone & McLean, 2003) to examine the impact of KMS quality on users' post-adoption stage behavior, namely their usage continuance and recommendation intention. Recommendation intention is another variable taken from the research of Li and Liu (2001). According to Chea and Luo (2008), the recommendation intention variable is one of the loyalty dimensions that is as important as the willingness to continuously use a system. Recommendation is an affectdriven behavior. The work motivation literature has made the connection between an affective response and affect-driven behaviors. In particular, the affective events theory (AET) posits that affective reactions in the workplace determine affect-driven behaviors. According to the AET, positive affect fostered helping behavior on the part of co-workers (Weiss & Cropanzano, 1996). Recommendation behavior is similar to helping behavior in that both forms of behavior result in selfless acts in which individuals assist others (Chea & Luo, 2008). In relation to knowledge management systems, recommendation behavior can motivate people to promote the system to others through word of mouth behavior.
The remainder of the paper is organized as follows. Section 2 discusses the theories underlying this research, including the KMS concept, DeLone and McLean's (2003) IS success model, and the expectation-confirmation model. Section 3 establishes the research model proposed in this study and relates it to the continuance intention concerning KMS usage. Section 4 describes the research method, including respondent selection, the research instrument, and the data analysis tools. Section 5 presents the results of the research, while section 6 discusses the theoretical and practical implications of the research. The final section presents the conclusions of the research.

Knowledge management system
A knowledge management system (KMS) is a KM technology and integration mechanism built to support the KM process (Alavi & Leidner, 2001;Becerra-Fernandez & Sabherwal, 2010). Wu and Wang (2006) stated that a KMS is an information system used to manage knowledge. Information technology (IT) can support the KM process in various ways such as helping employees to trade knowledge more easily, identifying an expert to ask about necessary information or knowledge, and accessing information derived from past projects (Alavi & Leidner, 2001). However, KM does not play a special role in IT (Alavi & Leidner, 2001).
According to Becerra-Fernandez and Sabherwal (2010), depending on its process, a KMS can be classified as one of four types, namely a knowledge discovery system, knowledge capture system, knowledge sharing system, or knowledge application system. A knowledge discovery system supports the new tacit and explicit knowledge development process from information and data or previous knowledge synthesis. A knowledge capture system supports the reception of explicit and tacit knowledge reception stored in three knowledge vaults: artifacts, people's minds, and an organization's entity. A knowledge sharing system supports the communication of explicit and tacit knowledge (referred to as exchange and socialization, respectively) to others. A knowledge application system supports the knowledge application process. Knowledge application is a process for utilizing knowledge without moving the knowledge itself.

DeLone and McLean's IS success model
The success of an information system is a multi-dimensional concept that can be measured from various perspectives. DeLone and McLean (1992) made an important breakthrough after reviewing the prior literature concerning information system success and proposing a comprehensive model of information system success. Their model consists of six variables: system quality, information quality, satisfaction, use, individual impact, and organizational impact. According to the model, system quality and information quality encourage people to use the system, as well as creating satisfaction based on system usage. Further, use and satisfaction affect each other. Both variables also impact each individual. The technology variables are represented by system quality and information quality, while the system effectiveness can be measured by use, users' satisfaction, individual impact, and organizational impact (DeLone & McLean, 2003). System quality is measured by several factors, including whether or not there are bugs, a good user interface, usage easiness, and the quality and maintenance of program code (Seddon, 1997). Information or knowledge quality is a dimension that describes the information quality created by the system (Seddon, 1997). The information quality can be measured in terms of information accuracy, completeness, relevance, precision, and upto-dateness (Bailey & Pearson, 1983;Ives, Olson, & Baroudi, 1983). The use variable can be measured by the system usage frequency (Seddon, 1997). Users' satisfaction is defined as users' feeling or behavior regarding the impact they receive from various factors in a particular situation (Bailey & Pearson, 1983). Individual impact is the users' perception of how important or beneficial the information system they are using is (DeLone & McLean, 2003), while organizational impact measures how far the system usage impacts the organization's overall performance (DeLone & McLean, 2003).
Ten years later, DeLone and McLean renewed their model. There is one addition to the new model, namely service quality, which reflects the importance of the service available to support the system's success, especially in the e-commerce field. Additionally, individual impact and organization impact are merged into one variable referred to as the net benefit.
Many studies use DeLone and McLean's IS success model as a reference point when creating a knowledge management success model, including Liu (2003), Wu and Wang (2006), Kulkarni, Ravindran, and Freeze (2007), Hidayanto, Limupa, Junus, and Budi (2015), and Pai and Zou (2013). It is important to recognize that there are two conceptual differences when making the transition: one is the move from information to knowledge and the other is the switch from a single information system to KM system implementation. Both of these differences lead to changes in the characterization of the constructs involved, as well as in the relationships between them in a success model (Kulkarni et al., 2007). Sometimes, knowledge management success models not only use one model (e.g., DeLone and McLean's model), but actually combine several models, for example, combine DeLone and McLean's model with the task-technology fit (TTF) Model (Pai & Zou, 2013), or adding DeLone and McLean's model to the construct of organizational support (leadership, incentive, co-worker and supervisor) (Kulkarni et al., 2007). In addition, Liu (2003) used Jennex and Olfman's (2003) knowledge system success model, which modified DeLone and McLean's revised IS success model by adding the constructs of technological resource, KM level, KM form as system quality; the constructs of KM strategy/process, richness, and linkages as knowledge quality; and the constructs of management support, IS KM service quality, and user KM service quality as service quality. Bhattacherjee (2001) researched the factors that can encourage users' willingness to continuously use an information system. To do so, Bhattacherjee (2001) adopted a model used in the marketing world known as the expectation confirmation model (ECM). The ECM is a model developed by Oliver (1980) to identify the variables that encourage customers to return and buy the same product. The four identified variables are expectation, performance perception, confirmation, and satisfaction. This framework showed that product repurchase or continuous service usage really depends on the user's satisfaction with the product and service (Oliver, 1980(Oliver, , 1993. Bhattacherjee (2001) described how a user's decision to continuously use an information system is similar to an individual's decision to return and buy a product or service. The decision is based on the impact of three things: (1) early reception of the information system or purchase; (2) experience of the system information or product's performance; and (3) potential change of earlier decision. Considering Oliver's model, Bhattacherjee (2001) then proposed to reuse the information system with variables such as perceived usefulness, confirmation, satisfaction, as well as reuse.

Expectation confirmation model
The expectation confirmation model has been used in various studies of consumers' behavior to investigate consumers' satisfaction and post-purchase behavior (e.g., the willingness to return and repurchase or complain), as well as to study market service (Dabholkar, Shepard, & Thorpe, 2000;Oliver, 1980Oliver, , 1993. The theory has been applied in various contexts, including purchase intention on mobile apps (Hsu & Lin, 2015), continuance intention to use electronic textbooks (Stone & Baker-Eveleth, 2013), continuance intention to use web-based services (Lee & Kwon, 2011), and continuance intention to use IPTV (Lin, Wu, Hsu, & Chou, 2012).
Many studies have used the expectation confirmation model, including Chea and Luo (2008), Li andLiu (2011), andBasten, Schneider, andMichalik (2013). Similar to DeLone and McLean's IS success model, the expectation confirmation model is also occasionally combined with other models or additional constructs. For example, Chea and Luo (2008) and Li and Liu (2011) used the ECM with the additional variables of perceived ease of use and recommendations to analyze the post-adoption behavior of eservice users, whereas Basten et al. (2013) used expectation confirmation theory (ECT) to analyze the extent to which software developers' expectations regarding knowledge contributions are fulfilled by organizations.

Hypotheses development and research model
This research relies on the expectation confirmation theory developed by Bhattacherjee (2001), which includes:


Perceived usefulness: as a form of performance expectation created by Oliver (1980Oliver ( , 1993.  Confirmation: using two variables from DeLone and McLean (2003), namely information quality and system quality. Service quality is not used because it refers to the initial model of DeLone and McLean (1992). In addition, the usage of these two variables also refers to the research of Wu and Wang (2006). In the context of knowledge management, service quality is not fit for use.

Satisfaction.
 Continuance intention to use. DeLone and McLean (2003) recognized that an information system's performance can determine the success of that system. KMS quality can be measured in terms of system quality and possessed information or knowledge quality. System quality is defined as how well the KMS performs the knowledge management process function, how well the knowledge is coded, and how well the KMS is supported by the associated information technology and infrastructure staff (Jennex & Olfman, 2003). According to Wu and Wang (2006), system quality can be determined based on whether or not there are errors in the system, how easy the information system is to use, the response time, the degree of flexibility, and the level of stability. Information or knowledge quality is a dimension that ensures contextually accurate knowledge can be captured by the appropriate person when it is needed (Jennex & Olfman, 2003). Information or knowledge quality can be measured in terms of information accuracy, completeness, relevance, precision, and upto-dateness Tona, Carlsson, & Eorn, 2012;Widiyanto, Sandhyaduhita, Hidayanto, & Munajat, 2016). In this research study, information quality is combined with knowledge quality because information quality can be used as a success measure for a traditional information system, while in the KMS context, the distinction between knowledge and information depends on both the context and the user. One processor's knowledge could be another's information; the knowledge provided to a given processor for a certain task at a certain time may be the only information available for another task or at a different time (Wu & Wang, 2006). System quality and information or knowledge quality can increase users' perceptions of the usefulness of the system. When accessing a KMS, the better the information the users obtain, the more beneficial the KMS will be seen to be (Wu & Wang, 2006). A good quality KMS that has less errors and bugs, as well as being easy to learn and easy to use, will also enhance the perception that the KMS is beneficial for users. A system full of errors and bugs will certainly not be accessed maximally in order to improve users' work. Additionally, Jennex and Olfman (2003) noted the relation between system quality and information or knowledge quality and the perceived usefulness of KMS usage in nuclear power companies. Therefore, it is surmised that there is a positive relationship between system quality and information or knowledge quality and users' perceived usefulness, as formulated by the following hypotheses:

KMS quality's impact on perceived usefulness, satisfaction, and trust
H1: System quality has a positive impact on perceived usefulness. H2: Information or knowledge quality has a positive impact on perceived usefulness. Some researchers in the marketing field have recognized that product and service performance is the main factor that determines consumers' satisfaction (Kim, Zhao, & Yang, 2008). Product performance is equivalent to the quality perception of an information system (DeLone & McLean, 2003), which has been empirically confirmed in various studies . A good KMS system will satisfy its users. Good information or knowledge quality will also build users' satisfaction. When users access a KMS and gain the accurate and precise data they needed, the users will gain satisfaction (Tona et al., 2012). This issue has also been addressed in studies by Wu and Wang (2006), Jennex (2005), Kim, Xu, and Koh (2004), and Bossen, Jensen, and Udsen (2013).
Thus, it is surmised that there is a positive relation between system quality and information or knowledge quality and users' satisfaction. Therefore, the research posits the following hypotheses: H3: System quality has a positive impact on satisfaction. H4: Information or knowledge quality has a positive impact on satisfaction.
A good KMS, aside from improving satisfaction and perceived usefulness, can also improve trust in the system. Trust can be defined as a specific belief in a competency of a reliable party (Gefen, 2004). When users feel the KMS performance is good, the system will be perceived as having characteristics that provide benefits when used . This triggers trust in the KMS. This theory is supported by the studies of Belanger, Hiller, and Smith (2002) and McKnight, Choudhury, and Kacmarc (2002).
This indicates that there is a relation between system quality and information or knowledge quality and users' trust in a system, as the following hypotheses suggest: H5: System quality has a positive impact on trust. H6: Information or knowledge quality has a positive impact on trust.

Perceived usefulness's impact on satisfaction, continuance intention, and recommendation
Perceived usefulness is an ex-post expectation variable or an expectation that is triggered after users use a system. This variable is adapted from the technology acceptance model developed by Davis, Bagozzi, and Warshaw (1989). Perceived usefulness has been empirically proven to consistently affect users, both in the early reception stage and after usage (Bhattacherjee, 2001). In the KMS context, users who gain benefit from the KMS performance as measured by a reliable system and useful information that serves to improve productivity will consider that the KMS is satisfactory. This is supported by the research of Lee and Kwon (2011), Li and Liu (2011), Chea and Luo (2008), Lin, Wu, and Tsai (2005), and Thong, Hong, and Tam (2006), who all identified a positive relation between perceived usefulness and users' satisfaction.
Based on that, the suggestion that there is a positive relation between both variables can be formulated into the following hypothesis:

H7: Perceived usefulness has a positive impact on satisfaction.
Perceived usefulness is one of the main motivating factors that encourage information system users to continuously use a system. After the users use the system and recognize that it can bring benefits to their work, they will be encouraged to keep using the system (Bhattacherjee, 2001). KMS usage is intended to help employees in managing the knowledge they have, thereby improving their performance. This performance improvement will likely lead to rewards from the organization. The effort to improve performance in order to gain rewards is, according to Bhattacherjee (2001), not dependent on a certain time or behavior, whether it is the early stages or later stages of system usage. This theory is supported by the research of Stone and Baker-Eveleth (2013) into electronic textbook usage continuity, as well as by the studies of Lin et al. (2005), Lee and Kwon (2011), and Li and Liu (2011).
Based on the above, it is surmised that there is a positive relationship between continuance intentions regarding KMS usage and perceived usefulness, as suggested in this hypothesis:

H8: Perceived usefulness has a positive impact on continuance intention.
According to Chea and Luo (2008), there are several post-system usage behaviors that are just as important as continuance intention, including word of mouth (WOM) or recommendation. A recommendation from users who have already used a system can encourage potential users to also use that system (Li & Liu, 2011). Moreover, according to Chea and Luo (2008), the decision to offer a recommendation is determined by the positive impact that users obtain. On the contrary, Chea and Luo (2008) stated if users obtain a negative impact, they will make a complaint. In the KMS context, a positive impact can encourage users to offer a recommendation depending on the perceived usefulness those users achieve (Li & Liu, 2011). Users who feel the benefit and positive impact of KMS usage will be encouraged to make a recommendation to other users.
Considering this, the present study surmises that there is a relationship between perceived usefulness and users' intention to make a recommendation, which can be formulated as the following hypothesis: H9: Perceived usefulness has a positive impact on recommendation.

Satisfaction's impact on trust, continuance intention, and recommendation
A good experience in the past can trigger trust (Hashim, Tan, & Andrade, 2012;Cofriyanti & Hidayanto, 2013). In the KMS context, a KMS that provides satisfaction to users can enhance their perception that the KMS is competent or trustworthy. Other researchers have also proved that past satisfaction can trigger trust, including Gefen (2004) and Singh and Sirdeshmukh (2002). In Chiu, Hsu, Lai, and Chang's (2012) research concerning the influence of trust on repeated online purchases, it was found that satisfaction encourages customers to trust an online store.
Thus, it can be assumed that there is a positive relationship between satisfaction and users' trust in a KMS, as formulated in the following hypothesis:

H10: Satisfaction has a positive impact on trust.
Satisfaction can be defined as an evaluation of product quality compared to the expectation prior to purchasing the product . Satisfaction is key to building long-term relationships as well as leading to repurchases (Chea & Luo, 2008). Szymanski and Henard (2001) found that users who are satisfied with a product's performance are less likely to pick another product or option. Lee and Kwon (2011) also found empirical evidence that users who are satisfied with a service will use that product frequently. Aside from encouraging continuous usage, satisfaction also encourages users to voluntarily offer positive information to other people (i.e., recommendation) (Li & Liu, 2011). Satisfaction with KMS usage will surely encourage employees to keep using the KMS on a daily basis. This satisfaction can even encourage users to share the positives of a particular KMS. There is a lot of information that can help people with their work, and it is easy to use. In other words, people can also recommend that others use a KMS.
Based on the above, it is surmised that there is a positive relationship between satisfaction and continuance intention regarding KMS usage, which is formulated in the following hypotheses: H11: Satisfaction has a positive impact on continuance intention. H12: Satisfaction has a positive impact on recommendation.

Trust's impact on continuance intention and recommendation
According to McKnight et al. (2002), trust's effect on trusting intention has already been confirmed. Kim et al. (2011) found that trust positively affects the commitment to use. Users' trust can increase their loyalty to the system, or alternatively encourage users to leave the system. Ercis, Unal, Candan, and Yildirim (2012) and Graf and Perrien (2005) stated that trust is the main antecedent of building long-term relationships, as well as being an antecedent of building loyalty and the intention to repurchase and recommend. Trust increases users' assurance regarding the expected behavior and reduces harmful worries . In the KMS context, someone who is expecting a benefit when using a KMS can be encouraged with trust. With that trust, users will be certain that the KMS will keep providing the necessary benefit and not disappoint. The benefit gained increases the trust rate of a KMS's users regarding the system's capability. In other words, competency fulfilment and the benefit gained by users from the KMS will trigger trust in the KMS, and that trust will drive the intention to offer recommendations to others.
Based on the above explanation, it is assumed that there is a positive relationship between KMS users' trust and their continuance intention regarding KMS usage and recommendation to others. Thus, the following hypotheses are proposed: H13: Trust has a positive impact on continuance intention. H14: Trust has a positive impact on recommendation.

Continuance intention's impact on recommendation
Recommendation and continuance intention are two post-adoption behavioral aspects (Chea & Luo, 2008;Li & Liu, 2011). Both are behaviors that are affected by positive impacts and other aspects with similar characteristics. Other than having the same trigger factor, both variables are also related to each other. Li and Liu (2011) stated that the intention to continuously use a KMS affects users' willingness to offer a recommendation. Li and Liu (2011) also found that satisfaction and loyalty are factors that determine positive word of mouth. According to Li and Liu (2011), continuance intention is seen as a loyalty dimension in relation to information systems. When users have the intention to continue using a system, they have gained a lot of benefit from using the system and are thus motivated to keep using it and promoting it by word of mouth. Therefore, Li and Liu (2011) concluded that continuance intention is a factor that triggers the willingness to make a recommendation. The same has been stated by Choi (2009).

Fig. 1. The research model
It is hence surmised that continuance intention regarding KMS usage affects users' intention to make recommendations to others. Therefore, the following hypothesis is formulated:

H15: Continuance intention has a positive impact on recommendation.
The research model's design can be seen in Fig. 1.

Data collection and analysis procedure
The first step in this research study was to contact ten companies that have already implemented a KMS. However, of those ten companies, only three were willing to be involved in the study. The three companies that expressed a willingness to participate are power plant, internet infrastructure, and IT consultant companies with a total of 131 respondents. The sampling in each company was achieved using the purposive sampling and snowball sampling methods. Purposive sampling is a sampling method used to meet certain goal (Trochim, 2000). The sample is not random, but is instead picked according to the research criteria, namely those who have used their company's KMS. Their knowledge management systems have features that support four types of KMS process: knowledge discovery, knowledge capture, knowledge sharing, and knowledge application process. For example, they use repositories of information, best practices, and lessons learned to support the knowledge discovery process; chat groups or discussion board features helps to support the knowledge capture process; the expertise locator feature and repositories of information help to support the knowledge sharing process; and the capture and transfer of experts' knowledge helps to support the knowledge application process. Table 1 displays the indicators that the study is applied to all KMSs, not to just one or some of the KMS types. Therefore, the research results can be applied to all types of KMS. The questionnaires were distributed via the human resource division of each company and sent to all relevant employees who were willing to participate.
The data analysis method used in this research is the partial least square (PLS) method. The PLS method does not require normality assumption. It is also insensitive to sample size considerations. Its estimation approach handles both very small and very large samples with greater ease than structural equation modelling (SEM). The PLS method is particularly useful in generating estimates with very small samples (sample size of 30 observations or less) where SEM programs are not applicable (Hair, Black, Babin, & Anderson, 2010). The major aim of the PLS method, which has been widely applied in marketing and business research, is to maximize the explained variance of the dependent latent variables (Hair, Ringle, & Sarstedt, 2011). According to Hair et al. (2011), PLS-SEM is a promising method that offers enormous potential for SEM researchers, especially in the marketing and management information systems disciplines. PLS-SEM is, as the name suggests, a more regression-based approach that minimizes the residual variances of the endogenous constructs.

Research instrument
This research used the questionnaire approach to gain data and test the proposed model. The questionnaire consisted of two parts, the respondent's profile and the main questions. In the first part, the respondents were asked to fill in data according to their profile and answer some questions related to their KMS usage. In the second part, the respondents were asked to state their agreement with the given statements using a five-point Likert scale, with each point representing disagree (1), less agree (2), neutral (3), agree (4), and really agree (5). Table 1 shows the operation of each research variable.

Respondents' demographics
This research study classifies the respondents' profile into several categories, namely gender, age, length of service, education level, frequency of KMS access, and time spent accessing the KMS. From the questionnaires, the total number of samples from the three companies is 131 respondents. Table 2 summarizes the respondents' demographics.

Measurement model test
This test is conducted to assess the extent to which a manifest or indicator variable can represent a latent variable. The PLS measurement model evaluation is conducted in three stages: the convergent validity test, the discriminant validity test, and the reliability test. The first step in the evaluating measurement model is testing the convergent validity. According to Ghazali and Latan (2012), the convergent validity test is conducted to see whether a manifest variable has a high correlation with the latent variable. The convergent validity test is conducted by examining the average variance extracted (AVE) score. According to Hair et al. (2011), the AVE score has to be higher than 0.5. As seen in Table 3, all the latent variables in this study have an AVE score higher than 0.5, thus fulfilling one of the convergent validity tests. According to Hair et al. (2011), aside from the AVE, the convergent validity test can also be determined based on the loading factor score in the indicator path of the latent variable. Table 3 depicts all the indicators that have a loading factor score higher than 0.7. Thus, all the indicators in this research study passed the convergent validity test.
Next, a reliability test has to be conducted. The reliability test is conducted to determine whether the indicators in the latent variable are consistent in terms of representing the latent variable (Chin, 2010). According to Ghazali and Latan (2012), the reliability test can be conducted by determining the Cronbach's alpha and composite reliability scores. Both scores must be higher than 0.7. As seen in Table 3, all the variables passed the reliability test because they have Cronbach's alpha and composite reliability scores higher than 0.7. Considering both test results, the present research instrument is concluded to be both valid and reliable.

Structural model test
After evaluating the measurement model, the next step is to determine the path significance in order to prove the hypothesis created by conducting the structural model evaluation. This step consists of two parts, namely examining the R-square (R 2 ) from the endogenous latent variable and examining the t-statistic score from the bootstrap method.
The testing of the R 2 is conducted to determine how far an exogenous latent variable affects the endogenous latent variable (Chin, 2010). According to Chin (1998), if the value of R 2 is greater than 0.67, then it can be concluded that the exogenous latent variable has a strong impact on the endogenous latent variable. If the value of R 2 is between 0.33 and 0.67, then it is categorized as medium impact, while if the value of R 2 is less than 0.33, then it is categorized as low impact. Table 4 demonstrates that all the endogenous latent variables have a score higher than 0.67. Thus, it can be concluded that the exogenous latent variable has a strong impact on the endogenous latent variable. The hypothesis allocation via the path that connects the exogenous latent variable to the endogenous latent variable is quite significant.
Next, the path coefficient and t-statistic tests are used to determine the relationship significance between the latent variables, and whether or not a hypothesis is acceptable is examined. According to Hair et al. (2011), one latent variable has a significant influence on another latent variable if it has a t-value score of 1.65 with a significance score of 10%. A path coefficient score between -0.1 and 0.1 is considered to be insignificant. After evaluating the structural model, it can be concluded whether or not a hypothesis is acceptable. The path coefficient and t-value results, as well as the hypothesis test results, can be seen in Table 5.

Discussion
According to the hypothesis test, system quality and information or knowledge quality both affect users' intention to continuously use a KMS. This research determined that perceived usefulness, satisfaction, and trust all influence users to continuously use a KMS, with the perceived usefulness acting as the strongest antecedent. The results also revealed that information or knowledge quality is the main antecedent of perceived usefulness. Further, this research found that intention to recommend is only affected by satisfaction with using the KMS, not by trust or perceived usefulness.

The impacts of KMS performance
According to the hypothesis test, KMS performance as represented by system quality and information or knowledge quality affects users' perceived usefulness. Information or knowledge quality has a significant impact on users' perceived usefulness. This is in line with the hypothesis that users will consider a KMS to be useful if there is a lot of information that can help with their work and is presented in a good way. Aside from that, KMS quality also affects perceived usefulness. This is in agreement with the findings of previous research by Jennex (2005) and Wu and Wang (2006).
KMS performance was also shown to have an impact on users' satisfaction level. A good KMS will surely generate satisfaction in its users. A KMS with a low error and crash rate will make users feel comfortable using the system. Additionally, when users access a KMS and gain accurate and precise knowledge, they will gain satisfaction (Tona et al., 2012). This finding is in line with previous research that identified a positive relation between system performance and users' satisfaction level, including the studies of Tona et al. (2012), Jennex (2005, Wu and Wang (2006), Kim et al. (2011), andBossen et al. (2013).
Aside from affecting perceived usefulness and satisfaction level, a KMS can also affect the trust impact on its users. According to Flavian, Guinalıu, and Gurrea (2006), trust can be measured by the extent to which a company can meet its clients' needs. In this research study, it was shown that a KMS that provides information and knowledge that meets users' needs can improve users' trust in the system. Further, according to Kim et al. (2004), trust in a website is triggered by the quality of the web system, while this research also proved that system quality on the part of a KMS triggers users to increase their trust in that KMS. Thus, this study supports the findings of previous research that there is a positive relation between system performance and trust level (Belanger et al., 2002;Chiu et al., 2012;Kim et al., 2004;McKinney et al., 2002;McKnight et al., 2002).

Perceived usefulness's impact on satisfaction, continuance intention, and recommendation
Perceived usefulness is a variable adapted from research by Bhattacherjee (2001) to identify what triggers users' motivation to continuously use an information system. Additionally, perceived usefulness triggers satisfaction and trust in a KMS. In this research, it can be seen that perceived usefulness has an impact on users' satisfaction and continuance intention to use a KMS. This result agrees with the findings of research conducted by Chea and Luo (2008), Lee and Kwon (2011), Li andLiu (2011), Stone andBaker-Eveleth (2013), Lin et al. (2005), and Bhattacherjee (2001).
However, the finding showed that perceived usefulness does not affect the intention to offer a recommendation to others. Li and Liu (2011) found that perceived usefulness in the e-service context can be a motivating factor for a customer to make a recommendation to others to use the particular e-service. In this research, it was shown that a KMS that offers a lot of benefits to its users does not encourage those users to make recommendations to others, which is in line with the research by Kulkarni et al. (2007) and Pai and Zou (2013). The difference in research scope could be one reason why the hypothesis is unproven in this study. In the studies by Chea and Luo (2008) and Li and Liu (2011), the research scope covered the post-adoption behavior of e-service users, whereas this research, as well as the studies by Kulkarni et al. (2007) and Pai and Zou (2013), focuses on KMS users. Additionally, knowledge is one of the competitive advantages for an individual (Standing & Benson, 2000), since knowledge can be seen as a political basis for power and identity. Someone who gains useful knowledge from a KMS can therefore improve his/her competitive advantage. This could result in a knowledge management barrier that creates an unwillingness on the part of certain users to offer recommendations to use the KMS so that others do not gain the same competitive advantage (Standing & Benson, 2000).

Satisfaction's impact on trust, continuance intention, and recommendation
According to Flavian et al. (2006), users' satisfaction has a relationship with the extent to which a website can achieve the required competency. In the KMS context, it can be said that a KMS that provides satisfaction to users can enhance their perception that the KMS is competent and reliable. This research study showed that there is a positive relation between users' satisfaction and trust level. This finding is in line with previous research by Gefen (2004), Singh and Sirdeshmukh (2002), Chiu et al. (2012), Kim et al. (2011), andHashim et al. (2012).
In terms of the information system scope, it has been shown that satisfaction can also be a factor that affects users' continuous usage intention (Bhattacherjee, 2001). Satisfaction is the main antecedent of improving users' intention to continuously use an information system (Bhattacherjee, 2001). Other researchers, including Li and Liu (2011), Stone and Baker-Eveleth (2013), Kim et al. (2011), Chea and Luo (2008), Tha et al. (2009), andChiu et al. (2012), have proved the positive relation between satisfaction level and continuance intention with regard to KMS usage. In this research study, satisfaction with a KMS was shown to encourage users' willingness to continuously use that KMS. A user who is satisfied with the system quality and who gains useful information will be willing to keep using the KMS.
The satisfaction felt by users has also been shown to encourage their willingness to offer recommendation to others to use a KMS. Satisfaction is shown to have a greater effect on users' likelihood of offering a recommendation than on their continuance intention regarding KMS usage. This finding supports the results of previous research by Chea and Luo (2008), Mooradian and Oliver (1997), Casaló, Flavián, and Guinaliu (2008), and Li and Liu (2001), who all concluded that satisfaction can encourage someone to make a recommendation to others.

Trust's impact on continuance intention and recommendation
Users' trust level can improve their loyalty to a system or, alternatively, encourage them to leave a system. Ercis et al. (2012) stated that trust is the main antecedent of building long-term relationships, as well as an antecedent of building loyalty. Furthermore, DeWitt, Nguyen, and Marshall (2008) stated that trust is one of the factors that can affect loyalty behavior. Loyalty behavior can be seen as the willingness to continuously use a system and make positive recommendations to others (Chea & Luo, 2008;Dick & Basu, 1994;Ercis et al., 2012;Reichheld, 2003). Research such as the studies by Chu andKim (2011), DeWitt et al. (2008), Ranaweera and Prabhu (2003), Shiau and Luo (2012), and Graf and Perrien (2005) has identified a positive relation between trust and continuance intention regarding KMS usage as well as offering recommendations to others.
In this research study, the level of trust in the KMS was shown to encourage users to continuously use the KMS, although it did not have a significant relation with their willingness to make a recommendation to others. Prior research such as the study by Graf and Perrien (2005) has investigated the trust variable in terms of its impact on the relation between companies and external parties such customers. Graf and Perrien (2005) found that trust can encourage customers to make recommendations to others. However, this does not seem sufficient to affect the difference in the findings in the KMS research context. This research study was conducted with internal company employees. A user, in this context an employee, does not require trust in order to trigger the willingness to convince other employees to use the KMS. It is suspected that the trust factor is more suitable in other context such as e-commerce or marketing that involve the relationship between a company and its customers.

Continuance intention's impact on recommendation
In this research study, the continuance intention regarding KMS usage was shown to encourage users to offer recommendations to others. This is in line with the findings of prior studies, which concluded there is a relationship between these two loyalty dimensions.
According to Li and Liu (2011), when information system users display the intention to keep using a system, they have gained a lot of benefit from using that system, which triggers the motivation to both reuse the system and promote the system through word of mouth. A study by Choi (2009) also found that users who have a high intention to keep using a system have a positive relationship with the intention to recommend that system to other via word of mouth.

Implications
Based on the results of this research, some implications for future research and practice can be suggested.

Theoretical implications
This research used the expectation confirmation model developed by Bhattacherjee (2001) as well as the information system success model developed by DeLone and McLean (2003). In using these two models, this research attempted to build a model to identify the factors that encourages users to continuously use a KMS and offer recommendations to others.
This research used the theory developed by Bhattacherjee (2001) to identify the factors that encourage users to continuously use an information system. In this research, perceived usefulness was shown to be the post-usage expectation that has to be fulfilled in order to trigger continuous system usage. Perceived usefulness was empirically shown to have the most significant impact on the continuance intention regarding KMS usage. Additionally, the satisfaction factor was shown to have the same effect as expectation confirmation theory.
In addition to identifying a relationship between perceived usefulness and satisfaction and users' continuance intention, the expectation confirmation model also concludes that there is a positive relation between perceived usefulness and satisfaction. This research strengthens the theory, since perceived usefulness was shown to have a relation with satisfaction. This research also determined a positive relation between trust and continuance intention regarding KMS usage. This confirms the theory developed by Li and Liu (2011).
In this research study, system quality and information or knowledge quality in a KMS were shown to affect perceived usefulness, satisfaction, and trust. Both factors also indirectly affected continuance intention regarding KMS usage. This finding supports DeLone and McLean's (2003) notion that system quality and information quality are key to implementing information system. DeLone and McLean's (2003) found that those two factors encourage both satisfaction and continuance intention. This research proved that there is a relation between system quality and information quality and satisfaction, as well as an indirect relation with continuance intention regarding KNS usage. Additionally, this research also confirmed the theories developed by other researchers, including Li and Liu (2011), who stated that there is a relation between trust and continuance intention regarding KMS usage.

Practical implications
This research proved that a KMS's perceived usefulness, satisfaction, and trust can be the main motivators for increasing the continuance intention regarding KMS usage. The three factors have to be supported by good KMS quality. This research identified a positive relation between KMS performance and satisfaction level, perceived usefulness, and trust level. KMS performance in this research is represented by the system quality and the information or knowledge quality. Therefore, companies need to pay attention to both system quality and information or knowledge quality in order to encourage employee to continuously use the KMS. In addition, a good level of trust between employees can also encourage the sustainable usage of the KMS. Therefore, companies need to enhance KMS quality so that the trust level is higher. It has also been proved that the satisfaction felt by users when accessing a good KMS encourages them to make recommendations to others.
Companies can improve the system quality of their KMS by creating a user interface that is easy to use, designing a user friendly appearance, improving KMS stability to minimize crashes and downtime, and improving the response time. Furthermore, companies need to improve information or knowledge quality by providing useful, easy to understand, applicable, accurate, and up-do-date information in a consistent format.

Conclusions
This research study resulted in a number of findings related to KMS quality and its relation with continuance intention regarding KMS usage. Based on the data analysis, the main factor that encourages users to continuously use a KMS is perceived usefulness. Perceived usefulness has the most significant impact on the continuance intention regarding KMS usage. Satisfaction and trust were also shown to affect users' intention to continuously use a KMS. Additionally, satisfaction was shown to affect users' intention to offer recommendations to others. KMS quality as represented by system quality and information or knowledge quality was shown to affect perceived usefulness, satisfaction level, and users' trust. Both latent variables were shown to be KMS quality factors that indirectly affect the continuance intention regarding KMS usage. In this research, trust and perceived usefulness were not shown to have a significant impact on the willingness to offer recommendations to others. This research involved a relatively small sample size, so we decided to use the PLS method to process the data. In studies such as Dijkstra (1983), the use of the PLS method has been criticized due to it being an unreliable estimation and testing tool. Therefore, increasing the number of respondents and changing the tool usage to covariance-based SEM such as Amos/Lisrel should be trialed in the future.