2.5.5 Critical success factors
In the sub chapter ‘strategic alignment’ the position of CSFs in the ‘management continuum’ (Kaplan
& Norton, 2004) has been stated. In the assignment description the identification of CSFs is
mentioned. Belonging to this identification is the sub question 6: ’What are critical success factors
and how can they be identified?’
Critical success factors are those factor that define the organization’s success. Rockart’s (1978)
definition is:
“CSFs are the limited number of areas in which satisfactory results will ensure successful
competitive performance for the individual, department or organization. CSFs are the few key
areas where "things must go right" for the business to flourish and for the manager's goals to
be attained” (Bullen & Rockart, 1981, p. 7).
Performance measurement in SMEs
07-12-15
Koen Brinkerink
11
According to Caralli et al. (2004) “CSFs are an explicit representation of the key performance areas
of an organization” (p. 11). They are addition to organizational goals and targets by which an
organization’s strategy can be achieved (Caralli et al., 2004). An alternative conception is that CSFs
are derived from strategy and are applied for strategy implementation (Anthony & Govindarajan in
van Veen-Dirks & Wijn, 2004). A similar stand is provided by Ferreira and Otley (2009) whom
postulate CSFs as the goals for achieving organizational vision and mission. Therefore, identifying
and monitoring CSFs is necessary in order to achieve strategic objectives (Ferreira & Otley, 2009).
Determining CSFs can be executed via several data collection methods (Amberg, Fischl & Wiener,
2005), among others: group interviewing, literature review, structured interviews, multi-variate
analyse or Delphi study.
The CSF-method of Bullen and Rockart (1981) is based on semistructed interviewing and can be
applied in order to 1. Establish manager’s information needs, 2. Supporting the strategic planning
process, 3. Supporting the information system planning process (Bullen & Rockart, 1981; Rockart,
1978), 4. Evaluating the reliability of information systems, 5. Identifying business treats and
opportunities, and 6. Measuring productivity (Caralli et al., 2004).
3 Method
For determining the information needs of managers and identification of CSFs, the CSF-method has
been applied. This method is developed by Bullen and Rockart (1981). Caralli et al. (2004) has further
developed the method by constructing guidelines for the method. Goal of the CSF-method is to
structure the data collection and analysis technique for identifying CSFs (Bullen & Rockart, 1981;
Caralli et al., 2004). This method is employed because it is a structured and detailed method (Caralli
et al., 2004); it guides researcher by means of providing steps to take (Caralli et al., 2004); it is a
systemic procedure for identifying managers’ information needs (Bullen & Rockart, 1981; Caralli et
al., 2004); and it can make tacit knowledge explicit (Caralli et al., 2004).
Data collection has been executed by means of semi-structured interviews and a document review
(Patton, 2002). Interview participants were managers and key personnel of BIE.
3.1 Data collection
Data collection has been executed by means of semi-structured interviews and a document review.
During interviews one can gain profound knowledge about a subject (Kvale, 1996) and influence the
interview direction, and therefore it is recommended by Caralli et al. (2004). During interviews
managers have the chance to discuss their management challenges and can present their
contribution in achieving the organization’s success (Caralli et al., 2004). Applied interview questions
are derived from Bullen and Rockart (1981); Caralli et al. (2004). Before interviews were executed
participant were informed about the method and what critical success factors are. During interviews
notes were taken. After completing interview analysis the data was presented to and verified by
participants.
Additionally a document analysis (Bowen, 2009; Saunders et al., 2009) has been performed.
Documents are written texts, they are nonreactive and no researcher inference is possible (Bowen,
2009). Documents were analysed for the identification of manager’s goals, objectives, roles,
responsibilities, functions, targets (Caralli et al., 2004). This data represent what managers though to
be important or critical for an organization (Caralli et al., 2004). Reviewed document consisted,
among others, of: organizational presentations; a quality plan; quality objective; and employee
meeting presentations.
3.2 Data analysis
Data analysis consist out of data reduction, data presentation, concluding and data validation (Miles
& Huberman, 1994). Data analysis starts when interviews are conducted (Kvale in Saunders et al.,
2009) and document are collected. Data reduction and presentations is executed by means of
content analysis in the following procedures: developing activity statements, placing activity
statements in affinity groups, developing supporting themes, developing and analysing critical
Performance measurement in SMEs
07-12-15
Koen Brinkerink
12
success factors (Caralli et al., 2004). Reporting and validating data (Miles & Huberman, 1994)
happens by recalling data.
3.2.1 Developing activity statements
Activity statements should reflect “something that the organization is already doing, paying attention
to, or monitoring (as established in goals, objectives, or operational activities), or reflect something
that the organization should be doing (such as barriers and challenges to effectiveness)”
(Caralli et
al., 2004, p. 65). With developing activity statements initial data extraction has been performed.
3.2.2 Developing affinity groups and supporting theme’s
After developing activity statements they were clustered (Miles, Huberman & Saldaña, 2013) based
upon affinity (Caralli et al., 2004). “The affinity grouping of activity statements is a way to summarize
the core thoughts and concepts from managers regarding those activities they most need to pay
attention to” (Caralli et al., 2004, p. 74). By means of affinity grouping supporting themes were
constructed. Supporting themes represent groups of activity statements that explain the intention
and essence of said statements based upon common ideas or conceptions (Caralli et al., 2004).
3.2.3 Developing critical success factors
From supporting themes CSFS can be deducted. “CSFs seem to have more clarity, usability, and
impact when they can be reduced to a brief, concise statement that captures the CSF’s essential
intent and description” (Caralli et al., 2004, p. 79). Critical success factors are “the limited number of
areas in which satisfactory results will ensure successful competitive performance for the individual,
department or organization. CSFs are the few key areas where "things must go right" (Bullen &
Rockart, 1981, p. 7).
3.3 Validity & generalizability
Validity of qualitative research can be achieved by employ multiple strategies (Creswell, 2009). I have
employed the following strategies:
Strategy (Creswell, 2009)
Appliance
Data triangulation
Not applied.
Member checking
Participants gained insight into data analysis and had to validate said data.
Rich descriptions
Not applied.
Explain researcher bias
I am inexperienced and therefore documented every step I took.
Present negated results
Not applied
Spend time in the field
I have been present in the organization for more than half a year.
Peer debriefing
Peer debriefing has been executed with internal and external supervisors.
Project review
External supervisors have reviewed this study.
Table 2. Appliance of validation strategies (Creswell, 2009) in this study
Precision and accuracy is strived for in qualitative research. Instead of generalizability (Creswell,
2009). Merits of qualitative research is the elaborative descriptions of the research context.
3.4 Ethics
It was necessary to explicate research ethics since I have dealt with managers’ confidential
information. In order to protect research participants and reduce response bias several strategies
posed by Creswell (2009) are applied.
3.5 Data analysis process
Confidential
4 Results
In this chapter the results of the interviews and document analysis are presented.
The presented results are the identified CSFs of BIE. “CSFs are the limited number of areas in which
satisfactory results will ensure successful competitive performance for the (…) organization. CSFs
are the few key areas where "things must go right" for the business to flourish” (Bullen & Rockart,
1981, p. 7). The identified CSFs are developed at the organizational level (Caralli et al., 2004). They
Performance measurement in SMEs
07-12-15
Koen Brinkerink
13
are derived from the mission, vision and strategy as well as what managers see as essential for
success of BIE.
4.1 Overview of critical success factors
The following table (table 11) present an overview of the critical success factors of BIE and their core
ideas. This overview provides insight into factors the organization must pay attention to in order to
be successful according to their managers.
The remainder of chapter 4 is confidential.
5 Advice
My advice for Batenburg Industriële Elektronica is based on theoretical and empirical findings
presented in previous chapters.
In the research objective the goal is stated: to determine the critical success factors of the
organization. Furthermore, an advice will be constructed concerning the development of a PMS by
means of providing guidance for the design and implementation process, as well as preconditions
and organizational requirements for developing a PMS. Therefore, in this chapter attention is
addressed to providing an advice.
First, the preconditions found in the literature are presented and applied to BIE. By analysing the
organizational conformance to these preconditions a detailed advice can be drawn up and actions
the organization has to undertake can be called upon.
Secondly, the design and developmental process and their requirements is discussed. This is based
upon literature and my own findings. By taking into consideration the characteristics of BIE a suitable
model and process methodology can be selected.
Thirdly, I describe the desired execution of the suitable PMS-model and developmental method for
BIE.
Lastly, I present recommendations aimed at organisational development that are detached from
PMS development. This part of my advice is founded in observations made during conducting this
study.
The remainder of chapter 5 is confidential.
6 Limitations
Confidential
6.1 Future research
Confidential
Performance measurement in SMEs
07-12-15
Koen Brinkerink
14
7 References
Ahn, H. (2001). Applying the Balanced Scorecard Concept: An Experience Report. Long Range
Planning, 34(4), 441-461. doi:
http://dx.doi.org/10.1016/S0024-6301(01)00057-7
Amberg, M., Fischl, F., & Wiener, M. (2005). Background of critical succes factor research. Erlangen-
Nurnberg Working Paper No 2/2005. Friedrich-Alexander-Universität Erlangen-Nürnberg.
Nürnberg.
Baba, Deros, M., Yusof, S. r. M., Azhari, & Salleh, M. (2006). A benchmarking implementation
framework for automotive manufacturing SMEs. Benchmarking: An International Journal,
13(4), 396-430. doi: 10.1108/14635770610676272
Basuony, M. A. (2014). The balanced scorecard in large firms and SMEs: A critique of the nature,
value and application. Accounting and Finance Research, 3(2), 14.
Biazzo, S., & Garengo, P. (2012a). The Balanced Scorecard for SMEs: A Circular Approach
Performance Measurement with the Balanced Scorecard (pp. 23-38). Berlin Heidelberg:
Springer
Biazzo, S., & Garengo, P. (2012b). Empirical Evidence: Implementing the BSC in SMEs Performance
Measurement with the Balanced Scorecard (pp. 81-133): Springer Berlin Heidelberg.
Biazzo, S., & Garengo, P. (2012c). Measuring Business Performances: The Balanced Scorecard
Model Performance Measurement with the Balanced Scorecard (pp. 1-21). Berlin Heidelberg:
Springer.
Bititci, U., Firat, S. U. O., & Garengo, P. (2013). How to compare performances of firms operating in
different sectors?
Production Planning & Control, 24(12), 1032-1049. doi:
10.1080/09537287.2011.643829
Bititci, U., Garengo, P., Ates, A., & Nudurupati, S. S. (2015). Value of maturity models in performance
measurement. International Journal of Production Research, 53(10), 3062-3085. doi:
10.1080/00207543.2014.970709
Bititci, U., Garengo, P., Dörfler, V., & Nudurupati, S. (2012). Performance Measurement: Challenges
for Tomorrow*. International Journal of Management Reviews, 14(3), 305-327. doi:
10.1111/j.1468-2370.2011.00318.x
Bourne, M., Mills, J., Wilcox, M., Neely, A., & Platts, K. (2000). Designing, implementing and updating
performance measurement systems. International Journal of Operations & Production
Management, 20(7), 754-771. doi: 10.1108/01443570010330739
Bourne, M., Neely, A., Mills, J., & Platts, K. (2003). Implementing performance measurement
systems: a literature review. International Journal of Business Performance Management,
5(1), 1-24.
Bowen, G. A. (2009). Document Analysis as a Qualitative Research Method. Qualitative Research
Journal, 9(2), 27-40. doi: 10.3316/QRJ0902027
Brem, A., Kreusel, N., & Neusser, C. (2008). Performance measurement in SMEs: literature review
and results from a German case study. International Journal of Globalisation and Small
Business, 2(4), 411-427.
Bullen, C. V., & Rockart, J. F. (1981). A primer on critical succes factors. Sloan WP, No. 1220-81.
Caralli, R. A., Stevens, J. F., Willke, B. J., & Wilson, W. R. (2004). The critical success factor method:
establishing a foundation for enterprise security management: DTIC Document.
Chalmeta, R., Palomero, S., & Matilla, M. (2012). Methodology to develop a performance
measurement system in small and medium-sized enterprises. International Journal of
Computer Integrated Manufacturing, 25(8), 716-740.
Cocca, P., & Alberti, M. (2010). A framework to assess performance measurement systems in SMEs.
International Journal of Productivity and Performance Management, 59(2), 186-200. doi:
10.1108/17410401011014258
Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches.
Thousand Oaks, CA: Sage publications.
de Leeuw, S., & van den Berg, J. P. (2011). Improving operational performance by influencing
shopfloor behavior via performance management practices. Journal of Operations
Management, 29(3), 224-235.
de Waal, A., & Kourtit, K. (2013). Performance measurement and management in practice.
International Journal of Productivity and Performance Management, 62(5), 446-473. doi:
10.1108/IJPPM-10-2012-0118
Performance measurement in SMEs
07-12-15
Koen Brinkerink
15
Doeleman, H. J., Thomassen, J.-P., & van Winzum, E. (2013). De 25 beste ideeën voor een meer
inspirerende planning & control: Kluwer,.
Edberg, D. T. (1997). CREATING A BALANCED IS MEASUREMENT PROGRAM. Information Systems
Management, 14(2), 32-40. doi: 10.1080/10580539708907043
Fernandes, K. J., Raja, V., & Whalley, A. (2006). Lessons from implementing the balanced scorecard
in a small and medium size manufacturing organization. Technovation, 26(5), 623-634.
Ferreira, A., & Otley, D. (2009). The design and use of performance management systems: An
extended framework for analysis. Management Accounting Research, 20(4), 263-282. doi:
http://dx.doi.org/10.1016/j.mar.2009.07.003
Franco-Santos, M., & Bourne, M. (2005). An examination of the literature relating to issues affecting
how companies manage through measures. Production Planning & Control, 16(2), 114-124.
doi: 10.1080/09537280512331333020
Franco-Santos, M., Kennerley, M., Micheli, P., Martinez, V., Mason, S., Marr, B., . . . Neely, A. (2007).
Towards a definition of a business performance measurement system. International Journal
of Operations & Production Management, 27(8), 784-801.
Franco-Santos, M., Lucianetti, L., & Bourne, M. (2012). Contemporary performance measurement
systems: A review of their consequences and a framework for research. Management
Accounting Research, 23(2), 79-119. doi:
http://dx.doi.org/10.1016/j.mar.2012.04.001
Garengo, P., & Biazzo, S. (2012). Unveiling strategy in SMEs through balanced scorecard
implementation: A circular methodology. Total Quality Management & Business Excellence,
23(1), 79-102. doi: 10.1080/14783363.2011.637800
Garengo, P., Biazzo, S., & Bititci, U. S. (2005). Performance measurement systems in SMEs: A
review for a research agenda. International Journal of Management Reviews, 7(1), 25-47.
Gomes, C. F., Yasin, M. M., & Lisboa, J. V. (2011). Performance measurement practices in
manufacturing firms revisited. International Journal of Operations & Production Management,
31(1), 5-30. doi: 10.1108/01443571111098726
Gravesteijn, M., Evers, F. J., Wilderom, C. P. M., & Molenveld, M. (2011). Leren van presteren op de
werkvloer via zelfontwikkelde prestatie-indicatoren. Management & Organisatie(5), 60-79.
Groen, B. A. C. (2012). Enabling employees through co-development of performance measures.
Enschede, Nederland: Universiteit Twente.
Groen, B. A. C., Evers, F. J., Gravesteijn, M., Molenveld, M., Schopman, R., & Wilderom, C. P. M.
(2015). Developing enabling performance indicators in an organisation with high employee
turnover: Longitudinal action research in a call centre. Work in progress.
Groen, B. A. C., van de Belt, M., & Wilderom, C. P. M. (2012). Enabling performance measurement in
a small professional service firm. International Journal of Productivity and Performance
Management, 61(8), 839-862. doi: 10.1108/17410401211277110
Hudson, M., Smart, A., & Bourne, M. (2001). Theory and practice in SME performance measurement
systems. International Journal of Operations & Production Management, 21(8), 1096-1115.
doi: 10.1108/EUM0000000005587
Hudson-Smith, M., & Smith, D. (2007). Implementing strategically aligned performance measurement
in small firms. International Journal of Production Economics, 106(2), 393-408. doi:
http://dx.doi.org/10.1016/j.ijpe.2006.07.011
Johnson, G., Scholes, K., & Whittington, R. (2008). Exploring corporate strategy: Text and cases.
Harlow, UK: Pearson Education.
Johnston, R., & Pongatichat, P. (2008). Managing the tension between performance measurement
and strategy: coping strategies. International Journal of Operations & Production
Management, 28(10), 941-967. doi: 10.1108/01443570810903104
Kaplan, R. S., & Norton, D. P. (1992). The Balanced Scorecard--Measures That Drive Performance.
Harvard business review, 70(1), 71-79.
Kaplan, R. S., & Norton, D. P. (1996). The balanced scorecard: translating strategy into action.
Boston, Mas: Harvard Business Press.
Kaplan, R. S., & Norton, D. P. (2004). Strategy maps: Converting intangible assets into tangible
outcomes. Boston, Mas: Harvard Business Press.
Kaplan, R. S., & Norton, D. P. (2008). The execution premium: Linking strategy to operations for
competitive advantage. Boston, Mas: Harvard Business Press.
Kennerley, M., & Neely, A. (2003). Measuring performance in a changing business environment.
International Journal of Operations & Production Management, 23(2), 213-229.
Performance measurement in SMEs
07-12-15
Koen Brinkerink
16
Kvale, S. (1996). InterViews. An introduction to qualitative research writing: Sage Publications,
Thousand Oaks, CA.
Lohman, C., Fortuin, L., & Wouters, M. (2004). Designing a performance measurement system: A
case study. European Journal of Operational Research, 156(2), 267-286. doi:
http://dx.doi.org/10.1016/S0377-2217(02)00918-9
McAdam, R. (2000). Quality models in an SME context: A critical perspective using a grounded
approach. International Journal of Quality & Reliability Management, 17(3), 305-323. doi:
10.1108/02656710010306166
Melnyk, S. A., Bititci, U., Platts, K., Tobias, J., & Andersen, B. (2014). Is performance measurement
and management fit for the future? Management Accounting Research, 25(2), 173-186. doi:
http://dx.doi.org/10.1016/j.mar.2013.07.007
Mettänen, P. (2005). Design and implementation of a performance measurement system for a
research organization. Production Planning & Control, 16(2), 178-188. doi:
10.1080/09537280512331333075
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis : an expanded sourcebook.
Thousand Oaks: Sage Publications.
Miles, M. B., Huberman, A. M., & Saldaña, J. (2013). Qualitative Data Analysis: A Methods
Sourcebook. Thousand Oaks: SAGE Publications.
Neely, A., Gregory, M., & Platts, K. (2005). Performance measurement system design: A literature
review and research agenda. International Journal of Operations & Production Management,
25(12), 1228-1263.
Neely, A., Mills, J., Platts, K. W., & Richards, A. H. (2002). Strategy and performance: getting the
measure of your business. Cambridge, UK: Cambridge University Press.
Neely, A., Richards, H., Mills, J., Platts, K., & Bourne, M. (1997). Designing performance measures: a
structured approach. International Journal of Operations & Production Management, 17(11),
1131-1152.
Nudurupati, S. S., & Bititci, U. S. (2005). Implementation and impact of IT-supported performance
measurement systems. Production Planning & Control, 16(2), 152-162. doi:
10.1080/09537280512331333057
Nudurupati, S. S., Bititci, U. S., Kumar, V., & Chan, F. T. S. (2011). State of the art literature review on
performance measurement. Computers & Industrial Engineering, 60(2), 279-290. doi:
http://dx.doi.org/10.1016/j.cie.2010.11.010
Papalexandris, A., Ioannou, G., Prastacos, G., & Eric Soderquist, K. (2005). An Integrated
Methodology for Putting the Balanced Scorecard into Action. European Management
Journal, 23(2), 214-227. doi:
http://dx.doi.org/10.1016/j.emj.2005.02.004
Parmenter, D. (2007). Key Performance Indicators: Developing, Implementing, and Using Winning
KPIs. Hoboken, New Jersey: John Wiley & Sons, Inc.
Patton, M. Q. (2002). Qualitative research and evaluation methods. Thousand Oaks, Calif.: Sage
Publications.
Pun, K. F., & White, A. S. (2005). A performance measurement paradigm for integrating strategy
formulation: A review of systems and frameworks. International Journal of Management
Reviews, 7(1), 49-71. doi: 10.1111/j.1468-2370.2005.00106.x
Rockart, J. F. (1978). Chief executives define their own data needs. Harvard business review, 57(2),
81-93.
Saunders, M., Lewis, P., & Thornhill, A. (2009). Research methods for business students. Harlow, UK:
Financial Times Prentice Hall.
Shahin, A., & Mahbod, M. A. (2007). Prioritization of key performance indicators: An integration of
analytical hierarchy process and goal setting. International Journal of Productivity and
Performance Management, 56(3), 226-240. doi: 10.1108/17410400710731437
Simons, R. (1995). Control in an Age of Empowerment. Retrieved 17-04-2015, 2015, from
https://hbr.org/1995/03/control-in-an-age-of-empowerment/ar/3
Sousa, S., & Aspinwall, E. (2010). Development of a performance measurement framework for SMEs.
Total
Quality
Management
&
Business
Excellence,
21(5),
475-501.
doi:
10.1080/14783363.2010.481510
Taticchi, P., Balachandran, K., & Tonelli, F. (2012). Performance measurement and management
systems: state of the art, guidelines for design and challenges. Measuring business
excellence, 16(2), 41-54. doi: 10.1108/13683041211230311
Performance measurement in SMEs
07-12-15
Koen Brinkerink
17
Taticchi, P., Balachandran, K. R., Botarelli, M., & Cagnazzo, L. (2008). Performance measurement
management for small and medium enterprises: an integrated approach. Journal of Applied
Management Accounting Research, 6(2), 57.
Taticchi, P., Tonelli, F., & Cagnazzo, L. (2010). Performance measurement and management: a
literature review and a research agenda. Measuring business excellence, 14(1), 4-18.
Taylor, A., & Taylor, M. (2014). Factors influencing effective implementation of performance
measurement systems in small and medium-sized enterprises and large firms: a perspective
from Contingency Theory. International Journal of Production Research, 52(3), 847-866. doi:
10.1080/00207543.2013.842023
van Veen-Dirks, P. M. G., & Wijn, M. F. C. M. (2004). Kritieke succesfactoren en de balanced
scorecard. Praktijkboek Financieel Management, 73, 20-01-20-20.
Wouters, M. (2009). A developmental approach to performance measures—Results from a
longitudinal case study. European Management Journal, 27(1), 64-78.
Wouters, M., & Sportel, M. (2005). The role of existing measures in developing and implementing
performance measurement systems. International Journal of Operations & Production
Management, 25(11), 1062-1082. doi: 10.1108/01443570510626899
Wouters, M., & Wilderom, C. P. M. (2008). Developing performance-measurement systems as
enabling formalization: A longitudinal field study of a logistics department. Accounting,
Organizations and Society, 33(4), 488-516.
Yadav, N., & Sagar, M. (2013). Performance measurement and management frameworks. Business
Process Management Journal, 19(6), 947-971. doi: 10.1108/BPMJ-01-2013-0003
Dostları ilə paylaş: |