https://dx.doi.org/10.24016/2025.v11.444
ORIGINAL ARTICLE
Construction, validity, and
reliability of the Scale of Readiness for Change (SRCAA) in adults with
alcoholism
Angie Lizet
Mestas-Mamani1, Saray Camila Ochoa-Mamani1, Julio Cjuno1*
1 School of
Psychology, Universidad Peruana Unión, Juliaca, Peru.
* Correspondence: jcjunosuni@gmail.com
Received: February 01, 2025 | Revised: March 16, 2025 | Accepted: May 22, 2025 | Published Online: May 22, 2025
CITE IT AS:
Mestas-Mamani, A. L., Ochoa-Mamani, S. C., Cjuno, J. (2025).
Construction, validity, and reliability of the Scale of Readiness for Change
(SRCAA) in adults with alcoholism. Interacciones,
11, e444. https://dx.doi.org/10.24016/2025.v11.444
ABSTRACT
Introduction: To establish better approaches
to alcoholism, this scale was developed with a focus on cognitive-behavioral
aspects. Objective: Considering alcoholism as an issue that requires self-efficacy
attention, the scale is designed to guide the psychotherapist in the behavioral
change process of the alcoholic patient. Method: This psychometric
research, with a non-experimental mixed-method descriptive design, is
delineated by a non-probabilistic sampling method that employs structural
equation modeling for an infinite sample. Using statistical software, the
Aiken's V was obtained from seven expert judges, and 20 items were considered
in the exploratory factor analysis for factor loadings (two factors) and
factorial weights (λ = 0.62 - λ = 0.94), with Kaiser-Meyer-Olkin and Bartlett's
test of sphericity results (KMO = 0.96, p < 0.01). Results: A
two-factor model was found with adequate goodness-of-fit values (CFI = 0.987;
TLI = 0.985; SRMR = 0.073; RMSEA = 0.077), with the removal of item C11 due to
its low factorial loading (λ = 0.24). The scale, which contains 19 items and 2
factors, shows a good reliability coefficient (Cronbach's Alpha and McDonald's
Omega ranging from 0.801 to 0.963). In terms of convergent validity, a strong
inverse correlation (Rho = -0.670; p = 0.000) was found between the SRCAA and
GAD-7. Conclusion: Based on these statistical findings, the scale
demonstrates that it meets the objective of identifying the degree of awareness
regarding alcohol consumption and the behavioral changes a person makes to
overcome the detrimental habit.
Keywords: Alcoholism, Behavioral Modification, Transtheoretical Model of Change,
Psychometrics and Addictions.
INTRODUCTION
Many societies
consider alcohol consumption to be part of their identity or culture (Andrade,
2021). As a chronic disease that leads to behavioral disturbances that persist
during abstinence, it also interferes with physical, mental, social, and
familial health (Díaz & Calderín, 2020). At the same time, Mondragón-Maya
et al. (2021) discuss the pattern of excessive alcohol consumption, which is
influenced by the number of drinks consumed and gender, it is mentioned that
when men exceed five drinks and women exceed four, they exhibit Excessive
Alcohol Consumption (EAC), if this consumption occurs once a month with periods
of abstinence, as Chung et al. (2018) note, we could be talking about potential
excessive alcohol consumption.
Reports from
international public health organizations show alarming data regarding
excessive alcohol consumption. The World Health Organization (WHO, 2021) stated
that “283 million people live with alcohol use disorders, of which 237 million
are male and 46 million are female, noting that alcohol consumption begins as
early as 14 years old”. The Panamerican Health Organization (PHO, 2020) in the
Regional Situation Report on Alcohol and Health in the Americas, indicated:
"Excessive alcohol consumption is responsible for 200 diseases, injuries,
trauma, neoplasms, HIV/AIDS infections and various mental disorders." In the region of Puno, the onset of alcohol
consumption is early; the National Institute of Statistics and Informatics
(NISI, 2021) reported an increase in alcohol consumption starting at the age of
15 years old.
From the
Transtheoretical Model, “which aims to describe the change process as a variant
composed of a series of transitions or stages” (Rondón & Reyes, 2019),
there is an innovative proposal in health promotion and disease prevention, as
it provides opportunities for specific interventions in the population targeted
by the actions (López, 2020). Initially, the Transtheoretical Model of change
is established as the primary theoretical basis for the development of the
scale due to its inclusion in the addiction psychotherapy system. Furthermore,
in the field of addiction behavior treatment (Prochaska & DiClemente,
2005), motivation for change is considered a key element in overcoming each
part of the change process, with stages detailed as pre-contemplation,
contemplation, preparation, action and maintenance; these stages describe how
the person recognizes the presence of a health problem. There is a solid
explanatory theoretical foundation, but it lacks internal consistency when
evaluating these stages through a questionnaire (Fahrenwald & Walker, 2003;
Matsumoto & Takenaka, 2004), as Rosen (2000) mentioned in his meta-analysis
to analyze the relationship between the stages and change processes, revealing
that cognitive and behavioral factors do not influence the same way in each
stage, this is the main criticism of the theoretical model; therefore, it is
decided to structure those cognitive change processes in the early stages:
pre-contemplation, contemplation, and preparation in the behavioral change
processes in the action and maintenance stages.
From the
reports presented, it is evident that excessive alcohol consumption brings with
it a range of challenges; in the psychological realm, we are faced with the
responsibility of establishing new theoretical-explanatory approaches to
provide treatment for alcoholism. Prior to this, it is necessary to have tools
that allow us to understand how the cognitive-behavioral change process is
progressing in relation to this condition, so that we can have a preliminary
diagnosis to guide and adapt the sessions to the patient’s needs. To contribute
to knowledge, a scale will be designed that meets optimal indicators of content
validity, construct validity, and reliability, which, through its items, will
allow the identification of the level of awareness regarding excessive alcohol
consumption and the behavioral changes the person exhibits to break this
harmful habit.
METHODS
Design
The research has a non-experimental, psychometric, and cross-sectional
design, since data collection took place over a period without manipulation of
the variable. The quantitative research method was used using statistical
models that typify the scale (Hernández et al., 2014).
Participants
A non-probability snowball sampling method was used for the sample due
to the difficulty in identifying participants who met the inclusion criteria,
which were: being over 18 years old, having consumed alcoholic beverages five
or more times in the past month, and providing informed consent for voluntary
participation. It is worth noting that once a participant was identified, they
were asked about their social circle and the possibility of identifying other
individuals who consumed alcoholic beverages before proceeding with the search
for additional participants.
For the exploratory factor analysis, a sample of 300 participants was
established; however, stratified sampling was not considered due to the
complexity of identifying potential participants. While the sample for the
confirmatory factor analysis was delimited with the Sample Size Calculator
(web) for structural equation modeling (Kim, 2005) considering the Confirmatory
Factor Analysis - Root Mean Square Error of Approximation (RMSEA) considering
expected RMSEA values of 0.05, a significance level of 0.01, a sample power of
95% and a loss rate of 20% for 20 items and 2 factors, resulting in a sample of
260 (Arifin, 2024), corroborated with the "Structural Equation
Models" of Arrogante (2018) where to have a significant sample the number
of items must be multiplied by 20, we see that our sample of 479 for the CFA
exceeded both sample calculations.
Instruments
The scale is based on the transtheoretical model of change (SRCAA) in
people with alcoholism problems, of Peruvian origin, in order to assess the
phase of change in which an individual is who shows signs of apparent abuse in
alcohol consumption from cognitive-behavioral, the resolution of the scale can
take up to 20 minutes at most and the way of giving an answer is given by a
Likert scale that varies from Almost Never = 1, Once in a while = 2, Sometimes
= 3, Frequently = 4 and Almost Always = 5, consists of 19 items and two
dimensions; cognitive (contemplation) and behavioral (preparation, action and
maintenance), the age for its application is from 18 years. The scale
guarantees its validation through a statistical analysis according to its
validity and reliability. To carry out convergent validity, a 7-item anxiety
scale (GAD-7) was applied, considering a Likert rating scale that ranges from
not at all = 0, some days = 1, more than half the days = 2, almost every day =
3. Where scores 0-5 refer to a mild level, 6-10 moderate level, 11-21 severe
level of anxiety symptoms. The scale has excellent internal consistency
(Cronbach α = .92) and good test-retest reliability (intraclass correlation =
0.83) (Spitzer et al, 2006).
Procedure
For the execution of the project in the first phase, the degree of
content validity of the items was evaluated by the evaluation of seven expert
judges, who have 3 years of experience in the clinical psychological treatment
of patients with alcoholism. In the second phase, permits were coordinated in
five health centers that had patients with the F10 diagnosis. Alcohol-related
disorders as mentioned in the International Classification of Diseases (World
Health Organization, 1992), was applied to the general public who voluntarily
responded to the scale, and was also applied only to individuals who responded
affirmatively to the filter question "Have you consumed alcohol more than
five times during the last month?" This process was carried out with the
help of 3 interviewers, data collection was done through physical surveys,
between May and August of this year, informed consent and instructions were
detailed to solve the scale by asking them to respond as sincerely as possible,
since they are guaranteed confidentiality and the degree of anonymity, by not
asking for the name and data that exhibit the identity of the respondent.
Data Analysis
The data obtained through the application of the scale were processed in
a rigorous manner in specialized software to optimize the statistical analysis;
Jamovi, JASP. 0.18.3. and Microsoft Excel were used. The first analysis of
content validity was carried out to find V-Aiken Analytics of expert responses,
considering 7 expert judges with 3 years' previous experience in the clinical
treatment of alcoholic patients. This process was analyzed through an Excel
spreadsheet made by Ventura-León (2019). As a result, the validity of only 20
items with adequate indicators of relevance, representativeness, and clarity is
observed.
Afterwards, the cleaning of those surveys with atypical values was
developed to begin the analysis based on statistical models. Once a clean
database was obtained, descriptive analyses were carried out, where the
numerical variables presented measures of central tendency and dispersion, as
well as the estimation of asymmetry and kurtosis where a value (g1, g2 <
±1.5) was considered to have a normal distribution; while for the categorical
variables, absolute and relative frequencies were estimated (Bonett & Price,
2015).
For construct validity in exploratory factor analysis, the
Kaiser-Meyer-Olkin test was applied, considering a KMO > 0.5 (Montanero,
2008), and Bartlett's sphericity contrast with a p < 0.05 indicated the
presence of latent factors in the construction proposal (Everitt & Wykes,
2002). To verify the factor weights and the presence of factors, the maximum
likelihood method and varimax rotation were used to verify the factors. The
factors are also identified by means of the sedimentation graph (Mavrou, 2015,
Kaiser, 1958). Items with factor loadings of λ < 0.40 were removed
(López-Aguado & Gutiérrez-Provecho, 2019), as well as those with high
polychoric correlation coefficients (r > 0.80) and those with a uniqueness
value of θ > 0.70 (Ramos-Barberán & Plata-Alarcón, 2015).
Subsequently, the confirmatory factor analysis was performed, verifying
the goodness-of-fit values with the WLSMV estimator, where the goodness-of-fit
indices such as the CFI and TLI were estimated, which for an adequate fit must
present values > 0.90 and the SRMR and RMSEA values < 0.08; Likewise, SEM
Modeling was performed to obtain the factor loadings of the construct
(Schermelleh-Engel et al, 2003). It is worth mentioning that high residual
error was also considered a criterion for item elimination.
To estimate the internal consistency of the scale and its dimensions,
Cronbach’s Alpha and McDonald's Omega coefficients were estimated
(Elosua-Oliden & Zumbo, 2008) where values > 0.70 indicated reliable
factors.
Finally, for external validity based on the relationship between
variables, associations were estimated using Spearman’s Rho correlation
(Campbell & Fiske, 1959), comparing SRCAA scores by dimension with GAD-7
scores to determine external validity based on relational evidence.
Ethical Considerations
The research
was analyzed and approved by the Ethics Committee of the University Peruvian
Unión (2021) with report number 2024-CEB-FCS – UpeU-067. Furthermore, the
ethical principles of research involving human subjects of the Declaration of
Helsinki (World Medical Association, 2024) were adequately complied with in the
process of this research, such as the use of informed consent.
RESULTS
Descriptive analysis
In Table 1, it is observed that the AFE sample
consisted of n=300 participants with an average age of 38 years, of which the
majority, 193 (64.3%), were male, 292 (97.4%) reported having higher education,
107 (35.7%) were single, and 232 (77.3%) stated that they had never sought help
from a psychologist. On the other hand, the AFC sample was made up of n=497
participants with an average age of 34 years, of which 309 (62.2%) were male,
448 (90.2%) indicated having higher education, 237 (47.7%) were single, and 370
(74.4%) had not sought psychological help.
Table 1. Characteristics
of the population at risk of alcohol consumption.
|
AFE Sample
(n=300) |
AFC Sample
(n=479) |
||
|
M |
SD |
M |
SD |
Age |
38.8 |
13.5 |
34.4 |
13 |
|
n |
% |
n |
% |
Gender |
||||
Female |
107 |
35.7 |
188 |
37.8 |
Male |
193 |
64.3 |
309 |
62.2 |
Education |
|
|
|
|
Primary |
0 |
0 |
2 |
0.4 |
Secondary |
8 |
2.6 |
47 |
9.4 |
Higher |
292 |
97.4 |
448 |
90.2 |
Marital
Status |
|
|
|
|
Single |
107 |
35.7 |
237 |
47.7 |
Cohabiting |
58 |
19.3 |
105 |
21.1 |
Separated |
45 |
15 |
56 |
11.3 |
Married |
40 |
13.4 |
46 |
9.3 |
Divorced |
37 |
12.3 |
37 |
7.4 |
Widowed |
13 |
4.3 |
16 |
3.2 |
Sought Help |
|
|
|
|
Yes |
68 |
22.7 |
127 |
25.6 |
No |
232 |
77.3 |
370 |
74.4 |
Note: SD = Standard deviation, AFE Sample = Sample for
exploratory factor analysis, AFC Sample = Sample for confirmatory factor
analysis.
Content Validity
In Table 2, the indices from Aiken’s V by item are
shown. The scores for the precontemplation dimension range from 0.43 to 0.67,
indicating that none of its items have relevance, representativeness, or
clarity, thus allowing us to eliminate them from the scale. On the other hand,
items with acceptable values are considered, where the indicators range from
0.81 to 1.0, showing high relevance, representativeness, and clarity, and
should be kept on the scale. In the contemplation dimension, items 16, 17, 19,
20, and 21 remain, for the preparation dimension, items 24, 26, 27, 29, and 30,
for the action dimension, items 33, 34, 37, 38, and 39, and finally, for the
maintenance dimension, items 41, 42, 44, 45, and 46 remain. Thus, 27 items were
eliminated for failing to meet the criteria for each dimension, leaving 20
items in the scale with optimal indicators that adequately describe the
theoretical model. Furthermore, modifications were made to some valid items to
make them clearer, according to the observations from the expert judges. Item
20, which originally said, "People who care about me will support me in
quitting drinking" was changed to "I know that people who care about
me will support me in quitting alcohol, but I doubt I will succeed," and
item 46, "I have managed to stay away from alcohol and will make an effort
to keep it that way" was replaced with "I have managed to stay away
from alcohol because of the new activities I continue to pursue."
Table 2. Content
validity based on Aiken’s V by items.
Dimensions |
Ítems |
Relevance |
Representativeness |
Clarity |
Precontemplation |
1 |
0.62 |
0.52 |
0.52 |
2 |
0.62 |
0.48 |
0.62 |
|
3 |
0.52 |
0.43 |
0.57 |
|
4 |
0.62 |
0.67 |
0.52 |
|
5 |
0.57 |
0.62 |
0.62 |
|
6 |
0.67 |
0.62 |
0.57 |
|
7 |
0.57 |
0.67 |
0.57 |
|
8 |
0.43 |
0.52 |
0.57 |
|
|
9 |
0.52 |
0.52 |
0.52 |
Contemplation |
10 |
0.52 |
0.57 |
0.57 |
11 |
0.62 |
0.52 |
0.48 |
|
12 |
0.52 |
0.57 |
0.48 |
|
13 |
0.52 |
0.52 |
0.48 |
|
14 |
0.43 |
0.52 |
0.48 |
|
15 |
0.52 |
0.48 |
0.52 |
|
16 |
0.95 |
0.95 |
0.95 |
|
17 |
0.95 |
1.00 |
0.95 |
|
18 |
0.52 |
0.57 |
0.52 |
|
19 |
1.00 |
1.00 |
0.95 |
|
20 |
0.81 |
0.76 |
0.81 |
|
21 |
0.95 |
1.00 |
1.00 |
|
|
22 |
0.48 |
0.52 |
0.52 |
Preparation |
23 |
0.52 |
0.52 |
0.48 |
24 |
1.00 |
0.95 |
0.95 |
|
25 |
0.48 |
0.48 |
0.57 |
|
26 |
1.00 |
1.00 |
1.00 |
|
27 |
0.95 |
0.95 |
1.00 |
|
28 |
0.57 |
0.57 |
0.52 |
|
29 |
0.86 |
0.86 |
0.86 |
|
30 |
1.00 |
1.00 |
0.95 |
|
|
31 |
0.57 |
0.52 |
0.52 |
Action |
32 |
0.57 |
0.52 |
0.52 |
33 |
0.95 |
0.90 |
1.00 |
|
34 |
0.95 |
1.00 |
1.00 |
|
35 |
0.52 |
0.57 |
0.52 |
|
36 |
0.52 |
0.62 |
0.52 |
|
37 |
1.00 |
1.00 |
0.90 |
|
38 |
1.00 |
1.00 |
0.95 |
|
39 |
1.00 |
0.95 |
0.90 |
|
|
40 |
0.57 |
0.62 |
0.52 |
Maintenance |
41 |
0.90 |
0.90 |
0.95 |
42 |
0.95 |
0.95 |
0.95 |
|
43 |
0.57 |
0.57 |
0.52 |
|
44 |
0.95 |
1.00 |
0.95 |
|
45 |
0.95 |
0.95 |
0.90 |
|
46 |
0.95 |
0.95 |
0.90 |
|
|
47 |
0.52 |
0.52 |
0.48 |
Note: The validity indices are determined through
Aiken’s V, with the participation of 7 expert judges.
Exploratory Factor Analysis
In Table 3, the final version of the 20 items was used
for the Kaiser-Meyer-Olkin test and Bartlett's sphericity test (KMO = 0.96, p
< 0.01), confirming the presence of two factors based on the variables
included, with factor loadings ranging from (λ = 0.62 - λ = 0.94), obtained
using the maximum likelihood method and a varimax rotation. This indicates that
theoretically, the items form two factors. Figure 1 of the scree plot shows the
relationship between the eigenvalues and the extracted factors in the exploratory
factor analysis, indicating the presence of two latent factors.
Table 3. Factor
structure of the scale. Descriptive analysis of the items in the SRCAA.
Items |
M |
SD |
g1 |
g2 |
Factor
Loadings |
KMO |
|
(factor 1) |
(factor 2) |
||||||
Scale
General |
|
|
|
|
|
|
0.96 |
C7 |
2.81 |
1.30 |
-0.13 |
-1.23 |
|
0.62 |
0.94 |
C8 |
2.39 |
0.94 |
-0.19 |
-1.01 |
|
0.69 |
0.86 |
C10 |
2.96 |
1.13 |
-0.24 |
-0.63 |
|
0.63 |
0.75 |
C11 |
2.46 |
0.91 |
0.20 |
0.13 |
0.65 |
0.80 |
|
C12 |
2.89 |
1.17 |
-0.46 |
-1.07 |
|
0.74 |
0.88 |
Pr2 |
2.10 |
1.47 |
0.93 |
-0.69 |
0.90 |
|
0.97 |
Pr4 |
2.29 |
1.37 |
0.66 |
-0.91 |
0.85 |
|
0.98 |
Pr5 |
2.31 |
1.57 |
0.64 |
-1.24 |
0.86 |
|
0.99 |
Pr7 |
2.08 |
1.44 |
0.90 |
-0.73 |
0.89 |
|
0.96 |
Pr8 |
2.21 |
1.49 |
0.71 |
-1.11 |
0.92 |
|
0.96 |
A3 |
2.18 |
1.49 |
0.80 |
-0.92 |
0.92 |
|
0.97 |
A4 |
2.13 |
1.43 |
0.79 |
-0.95 |
0.91 |
|
0.97 |
A7 |
1.87 |
1.40 |
1.23 |
-0.10 |
0.83 |
|
0.96 |
A8 |
2.40 |
1.64 |
0.59 |
-1.32 |
0.89 |
|
0.98 |
A9 |
2.34 |
1.43 |
0.65 |
-1.02 |
0.92 |
|
0.98 |
M1 |
2.29 |
1.51 |
0.63 |
-1.22 |
0.93 |
|
0.96 |
M2 |
2.38 |
1.61 |
0.57 |
-1.36 |
0.90 |
|
0.97 |
M4 |
2.17 |
1.52 |
0.77 |
-1.05 |
0.93 |
|
0.96 |
M5 |
2.37 |
1.58 |
0.53 |
-1.39 |
0.92 |
|
0.98 |
M6 |
2.26 |
1.53 |
0.63 |
-1.25 |
0.94 |
|
0.96 |
Note: M = Mean, SD
= Standard deviation, g1 = Skewness, g2 = Kurtosis
Figure 1. Scree Plot by
Factors.
Confirmatory Factor Analysis
The two-factor model, after the removal of item C11,
showed better and more appropriate goodness-of-fit values for the SRCAA (CFI =
0.987; TLI = 0.985; SRMR = 0.073; RMSEA = 0.077). Thus, the decision was made
to adopt this model (Table 4). The reason for removing item C11 was its low
factor loading in the CFA (e.g., in SEM modeling), which was λ = 0.24, along
with a high residual error. After removing this item, the factor loadings ranged
from λ = 0.39 to λ = 1.05 (Figure 2).
Table 4. Model Fit
Indices with WLSMV Estimator for the SRCAA with two factors.
Estimadors |
Initial
model (with item C11) |
Final model
(without item C11) |
X2
(151) |
812 |
590 |
CFI |
0.981 |
0.987 |
TLI |
0.978 |
0.985 |
SRMR |
0.083 |
0.073 |
RMSEA |
0.098 |
0.077 |
CI 95% |
0.082 –
0.094 |
0.070 -
0.083 |
Note: X² (df >) for the model versus base, CFI =
Comparative Fit Index, TLI = Tucker-Lewis Index, SRMR = Standardized Root Mean
Square Residual, RMSEA = Root Mean Square Error of Approximation, CI =
Confidence Interval.
Figure 2. Structural
Equation Model for the CFA of the Construct.
Figure 2 shows the final model where the factor and
the items it comprises are displayed. The findings show that in the
relationship between factors and items, no standardized estimators are below
0.39. Additionally, an inverse covariance between the factors is observed,
which would explain their difference rather than their complicity, thus
corroborating the theoretical foundation proposed.
Reliability
Regarding the reliability of the SRCAA, good
reliability (> 0.70) was reported for both factors based on the internal
consistency reliability indices, using Cronbach’s Alpha (α) and McDonald’s
Omega (ω). The results show that the Cognitive Factor has good reliability
(Cronbach’s Alpha (α) = 0.805; McDonald’s Omega (ω) = 0.801), and similarly for
the Behavioral Factor (Cronbach’s Alpha (α) = 0.963; McDonald’s Omega (ω) =
0.962). This determined that the instrument has good reliability.
Convergent validity
Regarding convergent validity, based on the
relationship with other variables, a Spearman’s Rho correlation was estimated
between the global score and the dimensional scores of the SRCAA and the GAD-7,
which assesses generalized anxiety. A direct and moderate correlation (Rho =
0.380; p = 0.000) was found between the cognitive factor and GAD-7, an inverse
and strong correlation (Rho = -0.690; p = 0.000) between the behavioral factor
and GAD-7, and an inverse and strong correlation (Rho = -0.670; p = 0.000) between
the SRCAA and GAD-7. In the cognitive factor, it is noted that if the
individual is not aware of their alcoholism, anxiety symptoms increase.
Meanwhile, in the behavioral factor, it is understood that if the participant
has strategies to cope with alcoholism, the anxiety symptoms decrease.
DISCUSSION
As the first
version of the Readiness to Change Scale in a population of people with
alcoholism problems, the scale showed adequate fit for a bifactor model. The
EFA indicates the presence of two latent factors and 20 items; however, the CFA
offers a two-factor model with 19 items with optimal fit and acceptable
reliability for use in this population.
In this
research study, regarding the statistical findings, five factors with a total
of 47 items were initially proposed for the scale. However, the results of the
Aiken’s V statistical analysis, which aims to quantify the degree of agreement
among judges regarding the relevance of the items and their correspondence with
their respective factors (Pedhazur & Schmelkin, 1991), showed that 27 out
of the 47 initial items did not meet the established criteria, such as
relevance, representativeness, and clarity. For this reason, the scale was
reduced to 20 items. Therefore, it is appropriate to mention that the
elimination of certain items was carried out based on the criteria proposed by
Polit and Beck (2017), who state that items with an Aiken’s V value below 0.70
should be modified or removed. In the scientific literature, the study
Psychometric Analysis of the Alcohol Use Disorders Identification Test (AUDIT)
in Peruvian University Students includes a sample of individuals aged between
18 and 51 years, both male and female. The results of this analysis indicate
that all items of the questionnaire were well-received by the evaluators,
except for items 2, 4, 5, and 9, which showed discrepancies regarding the
clarity of the questions. However, the validity of these items was confirmed,
as their Aiken’s V validity index reached a value of 0.80, which is considered
acceptable (Colán & Rosario, 2022).
Secondly,
through Exploratory Factor Analysis (EFA), the presence of two latent factors
and 20 items with adequate factor loadings is confirmed. Similarly, several
items showed a low correlation load towards their respective factors
(precontemplation, contemplation, preparation, action, and maintenance),
leading to the identification of two latent factors: cognitive and behavioral.
On the other hand, a study conducted by Wild et al. (2019) on the
Abstinence-Related Change Readiness Scale (AACRS) initially proposed five
factors based on the principles of the Transtheoretical Model of Change (TMC).
However, due to the results of the EFA, it was determined that two of the
factors should be combined, resulting in four final factors with scores greater
than 0.65, indicating the strength and direction of the relationship between
each item and its corresponding factor. Similarly, a review of scientific
literature, particularly the work of Rosen (2000), suggests that better results
are obtained when this model is applied with only two factors: cognitive
processes and behavioral processes. Additionally, a study titled "Design
of Two Questionnaires to Evaluate Relapse and Recovery in Risky Alcohol
Consumption" analyzed a population of individuals aged 18 to 35 in Bogotá,
Colombia. In this study, the Recovery Predictors Questionnaire was analyzed
after the purification process, consisting of 32 items. The results indicated
that the sample adequacy test (KMO = 0.73) and Bartlett’s test of sphericity (p
< 0.00) confirmed the suitability of performing the analysis. Similarly, for
the Relapse Predictors Questionnaire, the values obtained were also KMO = 0.73
and p < 0.00 in Bartlett’s test of sphericity, indicating that the results
were adequate (Vargas et al., 2022).
Third, a
two-factor model showed adequate fit. However, upon removing item C11 (λ =
0.24), improvements were observed in the Comparative Fit Index (CFI = 0.987),
suggesting that the model adequately represents the relationships between the
observed variables and fits the sample (Sebnem et al., 2020; Lai, 2020). The
Tucker-Lewis Index (TLI = 0.985), where values above 0.95 are generally
considered optimal (Escobedo et al., 2016), and the Standardized Root Mean
Squared Residual (SRMR = 0.073), which indicates minimal differences between
observed and model-predicted covariances, suggest an optimal fit (Sebnem et
al., 2020). Furthermore, the Root Mean Squared Error of Approximation (RMSEA =
0.077) suggests that the model demonstrates an acceptable fit (Sebnem et al.,
2020). Consequently, it can be concluded that the model with two factors and 19
items (CFI = 0.987; TLI = 0.985; SRMR = 0.073; RMSEA = 0.077) provides superior
results. Similarly, in the study by Colán and Rosario (2022), the AUDIT
questionnaire showed adequate fit indices for a three-dimensional model, with
the following values: RMSEA < 0.07, SRMR > 0.08, CFI > 0.95, and TLI
> 0.95. On the other hand, the Recovery Predictors Questionnaire presented
the following indices: RMSEA < 0.067, CFI > 0.943, and TLI > 0.934.
Regarding the Relapse Predictors Questionnaire, the obtained indices were:
RMSEA < 0.052, CFI > 0.905, and TLI > 0.886. Consequently, it can be
concluded that the questionnaires demonstrate a good fit (Vargas et al., 2022).
Fourth,
regarding the reliability of the two-factor version of the scale; the cognitive
factor (Cronbach’s Alpha = 0.805; McDonald’s Omega = 0.801) and the behavioral
factor (Cronbach’s Alpha = 0.963; McDonald’s Omega = 0.902) demonstrate that
the instrument exhibit's good reliability. Specifically, for the omega
coefficient, values between 0.70 and 0.90 are considered acceptable (Campo
& Oviedo, 2008). Similarly, Cronbach’s Alpha values ranging from 0.70 to
0.90 indicate strong internal consistency, suggesting that the instrument is
reliable in measuring consistently across different situations and/or
populations (Oviedo & Campo, 2005). In a similar study, the AUDIT
questionnaire showed adequate reliability values, with a coefficient of 0.86
for Cronbach's alpha and 0.87 for McDonald's coefficient (Colán and Rosario,
2022). In other studies, such as that of Vargas et al. (2022), the following
values were reported for the Relapse Predictors Questionnaire: Cronbach's alpha
for all items was 0.71, while McDonald's Omega coefficients ranged from 0.53 to
0.77. Regarding the Recovery Predictors Questionnaire, Cronbach’s alpha value
for all items was 0.98, and McDonald's Omega coefficients ranged from 0.970 to
0.972, reflecting excellent internal consistency.
Regarding
convergent validity, Yang & Mindrila (2020) suggest that various
instruments should be compared to determine the level of correlation.
Accordingly, Spearman’s Rho correlation was estimated between the total score
and the subscale scores of the SRCAA scale and the GAD-7, which assesses
generalized anxiety. A moderate positive correlation (Rho = 0.380; p = 0.000)
was found between the cognitive factor and the GAD-7, a strong negative
correlation (Rho = -0.690; p = 0.000) between the behavioral factor and the
GAD-7, and a strong negative correlation (Rho = -0.670; p = 0.000) between the
SRCAA and the GAD-7. Regarding the literature review, it was found that García
et al. (2016) conducted a study on the validity of the Alcohol Use Disorders
Identification Test (AUDIT), in which convergent validity was assessed by
considering the Alcohol Use Disorders Identification Test - Consequences
(AUDIT-C) and the Alcohol Use Disorder Severity (AUDIT). The results revealed a
significant correlation, suggesting that the scales measure the same construct.
Limitations
and Strengths
Regarding the
limitations identified during the research, there are two key aspects: First,
the study was conducted with individuals over the age of 18, which limits the
generalizability of the findings to minors who engage in excessive alcohol
consumption, compounded by the limited accessibility to the population due to
potential cognitive avoidance present in the sample. Secondly, there is a
shortage of addiction specialists within our region. Thirdly, the literature
review revealed a scarcity of studies adapted to our specific context. It is
also worth noting that measurement invariance was not evaluated due to
subgroups with underspecified sample sizes, which prevented the development of
a multigroup CFA analysis. Future studies with representative strata in each
subgroup could assess invariance by age, gender, marital status, and education
level. Lastly, our strength lies in the fact that our instrument, being novel
and original in our context, offers an innovative contribution to the body of
research in this field.
Conclusions
The aim of
this study was to evaluate the reliability and validity of the Scale of
Readiness for Change in Adults with Alcoholism (SRCAA). The results indicated
that the scale, with 2 factors and 19 items, provides robust evidence of
validity concerning its internal structure and external validity, as well as optimal
reliability. Therefore, it can be effectively applied in clinical and research
settings. Application in Diverse
Contexts: Future studies should include more diverse samples and validate the
questionnaire in different cultural and clinical settings, ensuring measurement
invariance. Sample Expansion: Conduct studies with larger and more diverse
samples to enhance the external validity of the SRCAA and ensure the instrument
is suitable for various subgroups. Form Establishment: Implement norms to facilitate
the interpretation of scores relative to a reference group, such as
percentiles, standard scores, or other comparison systems.
ORCID
Angie Lizet Mestas-Mamani: https://orcid.org/0009-0005-3233-9732
Saray Camila Ochoa-Mamani: https://orcid.org/0009-0004-6781-9704
Julio Cjuno: https://orcid.org/0000-0001-6732-0381
AUTHORS’
CONTRIBUTION
Angie Lizet Mestas-Mamani:
Conceptualization, investigation, writing, review, supervision, and approval of
the final version.
Saray Camila Ochoa-Mamani: Review,
supervision, and approval of the final version.
Julio Cjuno: Conceptualization,
methodology investigation, writing, editing, translation, statical analyses and
approval of the final version.
FUNDING SOURCE
Self-funding.
CONFLICT OF INTEREST
The authors declare that there were no conflicts
of interest in the collection of data, analysis of information, or writing of the
manuscript.
ACKNOWLEDGMENTS
Not applicable.
REVIEW PROCESS
This study has been reviewed by external peers in double-blind mode. The
editor in charge was Renzo Rivera. The review process is included as supplementary
material 1.
DATA AVAILABILITY STATEMENT
The authors attach the database in supplementary material 2.
DECLARATION OF THE USE OF GENERATIVE ARTIFICIAL INTELLIGENCE
The authors declare that they have not made use of artificial intelligence-generated
tools for the creation of the manuscript, nor technological assistants for the writing
of the manuscript.
DISCLAIMER
The authors are responsible for all statements made in this article.
REFERENCES
Andrade, W. (2021). Stress and
alcohol consumption during the COVID-19 pandemic. Retos de la Ciencia, 5(11). https://imsama.edomex.gob.mx/sites/imsama.edomex.gob.mx/files/files/omexdat/articulos/estres_y_consumo_de_alcohol_durante_pandemia_covid_19.pdf
Arifin, W. N. (2024). Sample
size calculator (web). Wnarifin.github.io. http://wnarifin.github.io
Arrogante, Ó. (2018). Structural
equation models in Nursing: Methodology and application in nursing research. Index de Enfermería, 27(1-2), 67-71. http://scielo.isciii.es/scielo.php?script=sci_arttext&pid=S1132-12962018000100014&lng=es&tlng=es.
Bonett, D. & Price, R.
(2015). Varying coefficient meta-analysis methods for odds ratios and risk
ratios. Psychological Methods, 20(3), 394–406. https://doi.org/10.1037/met0000032
Campbell, D. & Fiske, D.
(1959). Convergent and discriminant validation by the multitrait-multimethod
matrix. Psychological Bulletin, 56(2), 81-105. https://doi.org/10.1037/h0046016
Campo A. & Oviedo, H. (2008).
Psychometric properties of a scale: Internal consistency. Revista de Salud Pública, 10(5), pp. 831-839. https://www.redalyc.org/pdf/422/42210515.pdf
Chung, T., Creswell, K.,
Bachrach, R., Clark, D. & Martin, C. (2018). Adolescent binge drinking:
Developmental context and opportunities for prevention. Alcohol Research:
Current Reviews, 39(1), 5-15. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6104966/
Colán, A. C. & Rosario, F. J. (2022). Psychometric
Analysis of the Alcohol Consumption Detection Questionnaire – AUDIT in Peruvian
University Students. Veritas et
Scientia, 11(2), 3-7. https://doi.org/10.47796/ves.v10i2.688
Díaz, M. & Calderín, J.
(2020). Alcohol
withdrawal syndrome: Result of oxidative stress and neuronal imbalance. Estado del arte. Revista
Biomédica, 31(2), 95-107. https://doi.org/10.32776/revbiomed.v31i2.779
Elosua-Oliden, P. & Zumbo, B.
(2008). Reliability
coefficients for ordered categorical response scales. Psicothema, 20(4), 896–901. https://reunido.uniovi.es/index.php/PST/article/view/8747
Escobedo, T., Hernández, A.,
Estebané, V. & Martínez, G. (2016). Structural equation models: Characteristics, phases,
construction, application, and results. Ciencia & Trabajo, 18(55),
16-22. https://doi.org/10.4067/S0718-24492016000100004
Everitt, S. & Wykes, T.
(2002). Dictionary of statistics for psychologists. Ariel
Fahrenwald, N. L. & Walker,
S. N. (2003). Application of the Transtheoretical Model of Behavior Change to
the Physical Activity Behavior of WIC Mothers. Public Health Nursing,
20(4), 307-317. https://doi.org/10.1046/j.1525-1446.2003.20408.x
García, M. Á., Novalbos, J. P., Martínez, J. M., & O’Ferrall, C.
(2016). Validation of the test for the identification of alcohol use disorders
in university population: AUDIT and AUDIT-C. Addictions, 28(4), 194-204.
https://doi.org/10.20882/adicciones.775
Hernandez, R., Fernandez, C.
& Baptista, M. (2014). Research methodology. McGraw-Hill
Interamericana Editors. Mexico. https://www.esup.edu.pe/wp-content/uploads/2020/12/2.%20Hernandez,%20Fernandez%20y%20Baptista-Metodolog%C3%ADa%20Investigacion%20Cientifica%206ta%20ed.pdf
Kaiser, H. (1958). The varimax
criterion for analytic rotation in factor analysis. Psychometrika, 23,
187–200. https://doi.org/10.1007/BF02289233
Kim, K. H. (2005). The Relation
Among Fit Indexes, Power, and Sample Size in Structural Equation Modeling. Structural
Equation Modeling: A Multidisciplinary Journal, 12(3), 368-390. https://doi.org/10.1207/s15328007sem1203_2
Lai, K. (2020). Fit Difference
Between Nonnested Models Given Categorical Data: Measures and Estimation. Structural
Equation Modeling: A Multidisciplinary Journal, 28(1), 99–120. https://doi.org/10.1080/10705511.2020.1763802
López-Aguado, M. & Gutiérrez-Provecho, L. (2019). How to perform and
interpret an exploratory factor analysis using SPSS. REIRE Journal,
12(2), 1–14. https://doi.org/10.1344/reire2019.12.227057
López, B. (2020). Stages of
change in relation to mammography in users of the family medicine unit No. 1 of
IMSS, Aguascalientes [Specialty Thesis, Universidad Autónoma de
Aguascalientes]. http://hdl.handle.net/11317/1843
Matsumoto, H. & Takenaka, K.
(2004). Motivational Profiles and Stages of Exercise Behavior Change.
International Journal of Sport and Health Science, 2, 89-96. https://doi.org/10.5432/ijshs.2.89
Mavrou, I. (2015). Exploratory
Factor Analysis; Conceptual and Methodological Issues. Nebrija Journal of
Applied Linguistics to Language Teaching, 19, https://www.nebrija.com/revista-linguistica/analisis-factorial-exploratorio.html#:~:text=El%20An%C3%A1lisis%20Factorial%20Exploratorio%20(AFE,observa%20y%20mide%20el%20investigador.
Mondragón-Maya, A., Flores-Medina, Y., López-Arreaga, G.,
López-Ramírez, S. & Paz-Rodríguez, F. (2021). Executive functions in university
students with excessive alcohol consumption patterns. Psychology and Health,
31(2), 295-306. https://doi.org/10.25009/pys.v31i2.2698
Montanero, J. (2008).
Multivariate Analysis. University of Extremadura. Publishing Service. http://hdl.handle.net/10662/2444
National Institute of Statistics
and Informatics (2021). PUNO: Non-communicable and communicable diseases,
2020. https://proyectos.inei.gob.pe/endes/2020/departamentales_en/Endes21/pdf/Puno.pdf
Oviedo, H. & Campo, A.
(2005). An approach to the use of Cronbach's alpha coefficient. Colombian
Journal of Psychiatry, 34(4), 572-580. http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0034-74502005000400009&lng=en&tlng=es
Panamerican Health Organization.
(2020). Alcohol. Regional Office for the Americas of the World Health
Organization. https://www.paho.org/es/temas/alcohol
Pedhazur, E. & Schmelkin, L.
(1991). Measurement, Design, and Analysis: An Integrated Approach. Psychology
Press. https://doi.org/10.4324/9780203726389
Polit, D.F. & Beck, C.T.
(2017). Nursing Research: Generating and Assessing Evidence for Nursing
Practice. Intensive and Critical Care Nursing, 10th ed, 784 p. https://doi.org/10.1016/j.iccn.2015.01.005
Prochaska, J. O. &
DiClemente, C. C. (2005). The transtheoretical approach. In Handbook of
Psychotherapy Integration, 2, 147–171. Oxford University Press. https://doi.org/10.1093/med:psych/9780195165791.003.0007
Ramos-Barberán, M. & Plata-Alarcón, W. (2015). Polychoric correlation in factor analysis with ordinal variables. Journal
Matemática. 13(1). https://www.revistas.espol.edu.ec/index.php/matematica/article/view/487/365
Rondón, J. & Reyes, B.
(2019). Introduction to the Transtheoretical Model: The Role of Social Support
and Sociodemographic Variables. Revista Electrónica de Psicología Iztacala, 22(3), 2601–2633. https://www.medigraphic.com/pdfs/epsicologia/epi-2019/epi193g.pdf
Rosen, C. (2000). Is the
sequencing of change processes by stage consistent across health problems? A
meta-analysis. Health Psychology, 19(6), 593-604. https://psycnet.apa.org/doi/10.1037/0278-6133.19.6.593
Schermelleh-Engel, K.,
Moosbrugger, H. & Müller, H. (2003). Evaluation of model fit in structural
equation modeling: Significance tests and descriptive goodness-of-fit measures.
Psychological Research Methods, Vol. 8, No. 2, pp. 23-74. https://doi.org/10.23668/psycharchives.12784
Sebnem, C., Eda, E., Fatma, O.,
Mücahide, G. & Ismet, E. (2020). Validation and reliability study of the
Moral Distress Questionnaire in Turkish for nurses. Latin American Journal
of Enfermagem, 6. https://doi.org/10.1590/1518-8345.2960.3319
Spitzer, R., Kroenke, K.,
Williams, J. & Löwe, B. (2006). A brief measure for assessing generalized
anxiety disorder: The GAD-7. Arch Intern Med, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
Tabachnick, G. & Fidell, L. (2019). Using Multivariate Statistics
(7th ed.). Pearson.
University Peruvian Unión. (2021, September). Code of Ethics for
Research. SCRIBD. https://es.scribd.com/document/594635435/02442876-8343
Vargas, P., Londoño P, C. & Avendaño-Prieto, B. L. (2022). Design of
Two Questionnaires to Evaluate Relapse and Recovery in Risky Alcohol
Consumption. Health and Addictions / Salud y Drogas, 23(1), 41-59. https://doi.org/10.21134/haaj.v23i1.641
Ventura-León, J. (2019). Back to
content-based validity. Adicciones, 34(4). https://doi.org/10.20882/adicciones.1213
Wild, T. C., Roberts, A. B. &
Hodgins, D. C. (2019). Development and validation of the Alcohol Abstinence
Change Readiness Scale (AACRS): A tool for assessing readiness for change in
individuals with alcohol use disorders. Journal of Substance Use and
Addiction, 25(3), 123-135. https://doi.org/10.1016/jsua.2019.01.005
World Health Organization (1992,
January). International Classification of Diseases: ICD-10 (10th ed.). https://www.who.int/classifications/icd/en/
World Health Organization (2021).
Global Alcohol Action Plan 2022-2030 to Strengthen the Implementation of the
Global Strategy to Reduce the Harmful Use of Alcohol. Department of Mental
Health and Substance Use. https://cdn.who.int/media/docs/default-source/alcohol/alcohol-action-plan/first-draft/global-alcohol-action_plan_first_draft_es.pdf?sfvrsn=59817c21_5
World Medical Association (2024,
December). WMA Helsinki Declaration – Ethical principles for medical
research in human beings. https://www.wma.net/es/policies-post/declaracion-de-helsinki-de-la-amm-principios-eticos-para-las-investigaciones-medicas-en-seres-humanos/
Yang, Y. & Mindrila, D.
(2020). Probing the Underlying Structure of Modern Expectancy-Value Theory in
Multicultural Education: A Bayesian Exploratory Factor Analysis. International Journal of
Educational Psychology, 9(1), 55–81. https://doi.org/10.17583/ijep.2020.4261
Construcción, validez y confiabilidad de la Escala de Preparación para
el Cambio (EPCAA) en adultos con alcoholismo
RESUMEN
Introducción: Con el objetivo de
establecer mejores enfoques frente al alcoholismo, se desarrolló esta escala
con un enfoque en los aspectos cognitivo-conductuales. Objetivo: Considerando
que el alcoholismo es un problema que requiere atención desde la autoeficacia,
la escala fue diseñada para orientar al psicoterapeuta en el proceso de cambio
conductual del paciente alcohólico. Método: Esta investigación
psicométrica, de diseño mixto no experimental y descriptivo, se basa en un
muestreo no probabilístico y emplea modelamiento de ecuaciones estructurales
para una muestra infinita. Utilizando software estadístico, se obtuvo el
coeficiente V de Aiken a partir de la evaluación de siete jueces expertos. Se
consideraron 20 ítems en el análisis factorial exploratorio, obteniéndose
cargas factoriales en dos factores y pesos factoriales entre λ = 0.62 y λ =
0.94. Los resultados de la prueba de adecuación muestral de Kaiser-Meyer-Olkin
y la prueba de esfericidad de Bartlett fueron KMO = 0.96 y p < 0.01,
respectivamente. Resultados: Se identificó un modelo de dos factores con
adecuados índices de ajuste (CFI = 0.987; TLI = 0.985; SRMR = 0.073; RMSEA =
0.077). Se eliminó el ítem C11 por su baja carga factorial (λ = 0.24). La
escala final, compuesta por 19 ítems agrupados en 2 factores, presentó
adecuados coeficientes de confiabilidad (Alfa de Cronbach y Omega de McDonald
entre 0.801 y 0.963). En términos de validez convergente, se encontró una
fuerte correlación inversa entre la EPCAA y el GAD-7 (Rho = -0.670; p = 0.000).
Conclusión: Con base en los hallazgos estadísticos, la escala demuestra
cumplir con el objetivo de identificar el grado de conciencia sobre el consumo
de alcohol y los cambios conductuales que una persona realiza para superar este
hábito perjudicial.
Palabras claves: Alcoholismo, Modificación Conductual, Modelo Transteórico del Cambio,
Psicometría y Adicciones.