In-Store Customer Behavior Analytics Using Computer Vision
Abstract
In the competitive landscape of modern retail, acquiring precise and real-time insights into customer behavior is a vital prerequisite for achieving sustainable competitive advantage. Nevertheless, methodological limitations inherent in conventional self-report instruments—such as surveys—and retrospective transactional data fail to capture consumers’ subconscious actions, thereby creating a pronounced gap between stated intentions and actual point-of-sale behaviors. Addressing this gap, the present study establishes an innovative analytical framework leveraging computer vision and image processing technologies to monitor and analyze shoppers’ physical behaviors in an objective, continuous, and non-intrusive manner. In this observational study, an automated pipeline integrating deep convolutional neural networks and multi-target tracking algorithms was deployed in an operational retail environment, capturing and processing spatiotemporal trajectories from 3,210 valid customer visits over a one-week period. The empirical findings reveal that a deceleration in shoppers’ walking velocity along product aisles serves as a robust behavioral indicator of the transition from spatial navigation to focused cognitive processing. Statistical analyses demonstrated the pronounced superiority of eye-level shelves in driving visual engagement and dwell time (p<0.001) relative to other shelf tiers. Furthermore, spatial heat-map analytics identified that 21.8% of the store floor area constituted “spatial blind spots.” Multiple linear regression analysis further indicated that the store spatial coverage ratio (β=0.41) and total dwell time (β=0.22) acted as significant positive drivers, whereas checkout delay (β=−0.28) exerted a detrimental effect on behavioral loyalty (repurchase frequency). By shifting the paradigm from post-hoc transactional audits to real-time behavioral intelligence, this study provides actionable implications for store layout re-engineering, physical space optimization, and loyalty strategy personalization, offering an evidence-based foundation for decision-making in next-generation smart retail.
Introduction
I
n the dynamic landscape of the contemporary economy, the retail sector has undergone profound structural changes driven by growing competition, persistent changes in consumer preferences, diversification of shopping channels, and rising expectations regarding shopping experience quality (Kostyal et al., 2026). Under these complex conditions, firms’ survival and sustainable competitive advantage are increasingly linked to their ability to understand customer behavior deeply, accurately, and in real time (Garrido-Moreno et al., 2024)). Key retail marketing decisions—including store layout optimization, shelf placement, comprehensive customer experience (CX) management, in-store promotional campaigns, and loyalty strategies—depend on a sound understanding of how consumers encounter and interact with the store’s physical environment (Lemmens et al., 2026). However, the empirical and theoretical literature suggests that traditional consumer research methods cannot fully meet these emerging demands. Historically, market research has relied heavily on self-report methods and conventional qualitative instruments, including in-depth interviews, focus groups, and structured questionnaires. Although relatively convenient and inexpensive, these instruments have substantial methodological limitations when representing actual consumer behavior (Salih et al., 2025; Theocharis et al., 2025). Previous studies indicate that consumers are often unable to clearly articulate their feelings, perceptions, and mental processes concerning products (Nazari Ghazvini et al., 2026). Moreover, implicit memory and unconscious perceptions are inaccessible to conventional measurement techniques, while interviewer bias and retrospective recall can distort verbal reports. The discrepancy between what customers say and what they actually do at the point of sale creates a substantial intention–behavior gap, which may contribute to misguided marketing decisions and product failures (Ghazvini et al., 2024).
This issue is particularly important when examining consumer decision-making within physical environments. A considerable share of purchases, particularly impulse purchases, involves immediate, intuitive, and sometimes unconscious decisions affected by the store’s visual and spatial stimuli (Rodrigues et al., 2021). A store is therefore not merely a venue for exchanging goods; it is an ecosystem in which experiences are produced, perceptions are shaped, and visual attention may be converted into purchase intentions. Nonetheless, comparisons between physical and online retail reveal a pronounced information asymmetry to the disadvantage of physical retailers (Cameron et al., 2025). Digital platforms can monitor clickstream data, page dwell time, and navigation routes, enabling real-time personalization and fine-grained experience optimization. Physical retailers, by contrast, often depend on retrospective outputs such as point-of-sale (POS) receipts and enterprise resource planning (ERP) systems (Li et al., 2023). Consequently, managers have limited visibility into what happens while customers walk through aisles, stop at shelves, touch or inspect merchandise, or encounter the store’s cold and hot zones.
Overcoming this information gap and the limitations of conventional methods requires objective, continuous, AI-based approaches (Nazari et al., 2023). Computer vision and image processing offer new possibilities for unobtrusively recording actual customer behavior (Castilla et al., 2024). Existing closed-circuit television cameras or intelligent vision sensors can be used to track movement trajectories, quantify dwell time in different zones, estimate visual engagement with particular shelf tiers, and identify physical actions such as picking up merchandise (Knof et al., 2024). Integrating image-derived behavior with customer relationship management (CRM) and transactional data may convert raw surveillance observations into strategic consumer knowledge. Despite expanding interest in digital transformation and smart retail, much of the literature concerns online settings, and relatively few studies comprehensively examine how image-based behavioral analytics relate to key marketing constructs such as satisfaction, engagement, and loyalty within physical stores (e.g., (Yang et al., 2025)). Operational challenges—including illumination changes, camera viewpoints, occlusion, and crowding—also require carefully formulated analytical frameworks if dependable evidence is to support layout redesign, spatial productivity, and conversion-rate improvements. Accordingly, the central research question is: How can intelligent image processing objectively capture and analyze customers’ physical behavior within stores, and how can the resulting patterns inform optimized marketing decisions and novel loyalty models? This study aims to establish an image-processing analytical framework for measuring in-store behavioral variables, including movement paths, stopping locations, and shelf engagement, to support evidence-based retail management.
The remainder of this article is organized as follows. Section 2 reviews the theoretical background and prior research on in-store behavior and computer vision. Section 3 describes the research methodology and proposed system architecture. Section 4 presents implementation findings and analyses. Section 5 discusses managerial implications and conclusions.
Literature Review and Theoretical Background
Over recent years, customer behavior analysis in shopping and commercial environments has moved beyond traditional, one-dimensional approaches toward the integration of artificial intelligence, cognitive indicators, and spatial analytics. Iranian research suggests that intelligent tools are crucial for uncovering complex and nonlinear consumption patterns. In a systematic review, Safinia and Ghavami (2024) found that combining the Internet of Things as an infrastructure for collecting environmental big data with AI as an interpretive tool provides a promising way to identify emotional and impulsive purchasing patterns (Safinia & Ghavami, 2024). Similarly, Gerami et al. (2023), examining deep learning in online stores, addressed data cleaning and the separation of purposeful activities from anomalies, reporting that careful behavioral-data preprocessing significantly increases the accuracy of models predicting purchase tendencies (Gerami et al., 2022). Kazemi and Sadatian (2025) developed a multilayer recommendation framework integrating digital behavioral profiling, machine learning, and behavioral economics (Kazemi & Sadatian, 2025). They showed how combining behavioral traces with intelligent algorithms could reduce cognitive decision errors and improve service personalization, reinforcing the need for structured behavioral data management also highlighted by Kouhzadi et al. (2022) (Kouhzadi et al., 2022).
Understanding visual perception and unconscious reactions forms another strand of the literature. In an eye-tracking experiment, Kimasi and Khoshnevis (2021) found that matching visual stimuli to individual characteristics improves objective attention indicators (Kimasi & Khoshnevis, 2021), such as total attention and gaze duration, although the relationship is moderated by need for cognition. Zahedi Noghabi et al. (2022), drawing on the eye–mind hypothesis, likewise found that individual characteristics and learning styles affect fixation duration and concentration, with deeper cognitive processing associated with longer and more stable fixations (Zahedi Noghabi et al., 2022). Neuromarketing investigations extend these explanations to brain activity. Homayounfar et al. (2023), using electroencephalography (EEG), reported a positive association between visually induced emotional arousal and message recall (Homayounfar et al., 2022). Shirkhodaei et al. (2023), examining the P300 component, found that visual stimuli play a more prominent role than auditory information in mental processing (Shirkhodaei et al., 2023). These findings underscore the relevance of visual information for understanding consumer attention and choice.
Visual attention also manifests in the physical store environment, where architecture and spatial organization shape purchasing behavior. Andalib et al. (2023) used grounded theory to model environmental sensory stimuli and concluded that visual and physical cues, interacting with spatial design, influence behavioral outcomes, including purchasing and loyalty (Andalib et al., 2022). At a broader spatial scale, Yaghoubi et al. (2021) used spatial interaction models and geographic information systems (GIS) to describe customer behavior as a function of geographic location and environmental attractiveness (Yaghoubi et al., 2021). Earlier data-mining studies, including Beshardoust and Asgharizadeh (2023), combined K-means clustering with Apriori association rules to optimize product placement according to complementary purchases; however, those analyses relied solely on post-purchase transaction records (Beshardoust & Asgharizadeh, 2022).
Despite these theoretical and methodological developments, three significant gaps remain in the domestic literature. First, most studies using AI and machine learning focus exclusively on websites and online retailers, overlooking behavioral dynamics in physical stores. Second, studies of visual attention and cognitive behavior are generally conducted in controlled laboratories using wearable instruments such as eye trackers or EEG headsets, which may have limited external validity in dynamic retail environments. Third, field studies either rely on self-report and qualitative techniques or analyze only POS data, leaving shopping paths, stopping locations, and visual shelf interactions largely unmeasured. This study therefore applies image processing to develop an objective, real-time, non-intrusive framework for capturing, quantifying, and analyzing behavior in the physical retail environment.
Alongside domestic research, the international literature offers a more developed account of the convergence of marketing with new vision technologies. Whereas much of the domestic work emphasizes online channels or instrument-based experiments, recent international studies increasingly deploy automated, real-time, unobtrusive systems within physical stores. The field has progressed rapidly from early geometric and statistical models toward deep learning, RGB-depth vision, edge computing, and the Internet of Things. An important starting point was recognition that conventional POS databases do not register pre-purchase preferences. Liu et al. (2016) devised a surveillance system classifying six shelf-facing customer behaviors, ranging from passing without interest to touching, inspecting, and placing goods in a basket (Liu et al., 2017). By integrating head orientation, body orientation across eight directions, and hand actions using dynamic Bayesian networks, they distinguished casual passage from meaningful product attention. To capture such behavior in real time, Liciotti et al. (2017) developed an integrated arrangement of vision and depth sensors with processing embedded locally on cameras, contributing to edge computing and connecting spatiotemporal shelf interactions to managerial decision-support systems (Liciotti et al., 2016).
The assessment of affective and psychological states subsequently became another dimension of shopping-experience analytics. Generosi et al. (2018), noting the limitations of questionnaires and self-report, proposed a system using biometric observations and deep-learning facial-expression analysis to monitor emotional reactions at retail touchpoints (Generosi et al., 2018). Alfian et al. (2019) combined NoSQL databases with big-data frameworks for real-time behavioral processing and used association rules to examine links between store dwell time and purchase conversion (Alfian et al., 2019). Paolanti et al. (2020) introduced the VRAI framework, using overhead cameras and parallel convolutional networks to improve accuracy and offer standardized datasets for person counting, re-identification, and shelf-interaction recognition (Paolanti et al., 2020). To address the sensitivity of end-to-end models to specific store geometries and lighting, Wen et al. (2021) proposed a modular hierarchical system that recognizes activities at different levels of abstraction and adapts to altered store configurations without retraining the entire network (Wen et al., 2021).
More recently, combining computer vision with IoT and cloud-computing infrastructures has expanded operational possibilities. Narvilas et al. (2022) evaluated cloud AI platforms and pretrained models, demonstrating the potential for accurate customer tracking and density heat maps with relatively limited training (Narvilas et al., 2022). Alipio et al. (2023) combined ultra-wideband (UWB) localization with single-shot detector (SSD) algorithms in a real supermarket to identify frequent routes and count human traffic in real time, reporting accuracy above 99% (Alipio et al., 2023). Zangana (2025) combined YOLOv8 for human detection and Mask R-CNN for item-boundary segmentation, overlaying shelf-planogram compliance with customer occupancy heat maps (Zangana, 2025). Yang et al. (2025) combined YOLOv8, DeepSORT, and computational geometry to automatically extract shoppers’ movement vectors and stopping points within large retail stores, improving continuity in crowded scenes (Yang et al., 2025). From a marketing perspective, Rastogi et al. (2025) grouped these technologies into facial affect assessment, dynamic personalization, and automated shelf inventory management (Rastogi et al., 2024). Nguyen et al. (2024) integrated mathematical behavioral models and deep neural networks to visualize individual and group micro-behavior and optimize movement routes (Nguyen et al., 2024). Ganokratanaa et al. (2024) combined YOLOv8 and DeepFace to extract estimated age, gender, and density indicators for reconsidering underused store areas (Ganokratanaa et al., 2024).
In parallel, researchers have investigated fundamental computational and geometric constraints. Gapski (2024) modeled geometric relationships between cameras and applied vision transformers to constrain spatial-localization and body-pose estimation errors under occlusion. Elhoseny et al. (2024) addressed computational demands on low-power devices using lightweight architectures, stacked autoencoders, and metaheuristic optimization, reporting 98.56% accuracy for complex human-behavior recognition on edge hardware without expensive centralized servers (Elhoseny et al., 2025). Memon et al. (2026) surveyed surveillance image processing, from contrast correction, edge detection, and optical flow under unstable lighting to deep learning for anomaly detection (Memon et al., 2026). Finally, Laskar et al. (2025) and AlZahrani (2026) reviewed opportunities such as immediate shopping personalization and automated detection of stock shortages, alongside barriers related to data privacy regulation, large labeled datasets, and the limited interpretability of deep neural networks (AlZahrani, 2026; Laskar et al., 2025). They identified edge computing, synthetic data, and multimodal AI as important directions for next-generation smart retail.
Methods and Materials
In terms of purpose, this is an applied and developmental study. Data collection and analysis follow an objective, non-intrusive observational approach relying on computer vision and spatiotemporal data. Its epistemological foundation is a contemporary positivist, data-driven behavioral paradigm: rather than relying on traditional self-report, retrospective recall, or questionnaires subject to perceptual bias, actual shopper actions—movement vectors, walking speed, stopping points, shelf dwell time, and spatial exploration—are measured as objective, quantitative variables. To enhance ecological validity, the investigation was carried out in an operating retail store. Its physical layout was divided, according to merchandising and planogram principles, into target zones: the entrance threshold and initial decision area, high-traffic principal aisles, special shelves and promotional displays, and checkout and payment areas.
Continuous video streams were captured using existing ceiling-mounted surveillance cameras directed obliquely downward, with Full HD resolution and a conventional video frame rate, providing adequate coverage without disrupting normal shopping activity. The automated processing pipeline comprised four connected steps. First, adaptive frame preprocessing stabilized illumination contrast and reduced reflections from glass shelving. A geometric homography then transformed perspective-distorted image pixel coordinates into real two-dimensional metric coordinates on the store floor plan, calibrating distances, displacements, and velocities in meters. Second, a single-stage deep convolutional neural network detected shoppers in individual frames. Multi-target tracking algorithms combining Kalman filtering with deep appearance descriptors maintained temporal continuity and assigned each individual a unique identifier, reducing identity switches caused by occlusion, crowds, and intersecting walking paths. Third, the resulting trajectories were used to derive complete entrance-to-exit paths, stopping points and shelf proximity dwell time, instantaneous speed, and spatial occupancy density; these features were stored as structured time series.
To convert technical observations into actionable management information, computed indicators were mapped to theoretical constructs from consumer behavior. The proportion of passersby stopping at a shelf was defined as the shelf attractiveness rate; time spent within the active shelf zone represented behavioral engagement and attention; mean motion and acceleration vectors represented shopping pace; trajectory continuity indicated traffic flow and spatial discoverability; and low-occupancy regions on spatial heat maps were classified as physical blind spots. For system validation, automated person counts and dwell time were compared with simultaneous manual observation by independent raters, and standard multi-object tracking and identity matching measures were assessed. To address research ethics and shopper privacy, distinguishing faces and biometric features were blurred and anonymized locally during preprocessing. Processing was restricted to the geometric behavioral descriptors, without retaining raw video recordings.
Findings and Results
The computer-vision system generated behavioral data through continuous monitoring of shoppers, spatiotemporal matrix extraction, and transformation of observed trajectories into objective marketing indicators. During the one-week field observation period, covering peak and off-peak hours, 3,480 unique customer tracking identifiers were recorded. After exclusion of incomplete tracks, defined as presence for fewer than 10 seconds at the entrance threshold, 3,210 valid, complete movement trajectories were available for analysis.
Stage 1: Technical performance and data validity. Before examining marketing indicators, detection and multi-object tracking performance was compared with manually annotated observations over randomly selected time windows comprising 600 seconds of high-traffic footage.
1. Shopper detection accuracy: Detection performance was assessed by mean average precision at an intersection-over-union threshold of 50% (mAP@0.50); the result was mAP@0.50 = 91.4%.
2. Multi-object tracking accuracy (MOTA): The following equation was used:
MOTA = 1 − [Σₜ(FNₜ + FPₜ + IDSWₜ)] / [Σₜ GTₜ]
Here FN denotes missed detections, FP false positives, IDSW identity switches during visual occlusion, and GT the ground-truth count. MOTA was 86.8%. The identity consistency score (IDF1) was 88.2%, suggesting reliable tracking under crowding.
Stage 2: Movement dynamics and spatial discoverability
(a) Walking speed and shopping pace. The instantaneous velocity of shopper i was calculated from calibrated ground-plane positions (x, y) and the frame interval Δt using the following expression:
vᵢ(t) = √[(xᵢ,t+Δt − xᵢ,t)² + (yᵢ,t+Δt − yᵢ,t)²] / Δt
Entrance threshold zone: Mean walking speed was 1.18 ± 0.21 m/s.
Main merchandise aisles: On approaching shelves, mean walking speed declined markedly (p < 0.001); reaching 0.58 ± 0.16 m/s. This reduction was interpreted as a shift from locomotor navigation toward cognitive processing and visual product evaluation.
(b) Physical blind-spot analysis. The walkable store floor was partitioned into 0.5 × 0.5 m cells. Occupancy density (D_c) for cell c was calculated as follows:
D꜀ = [Σᵢ₌₁ᴺ Tᵢ,꜀] / T_total
In this equation, the relevant quantity is the time customer i spent in cell c. The analysis indicated that 21.8% of total store area had an occupancy density below 5% (D_c < 0.05), suggesting poor discoverability of distant side aisles and inefficient utilization of floor space.
Stage 3: Shelf attractiveness and attention-capture rate
(a) Initial attractiveness rate (AR). For each shelf or zone k, the number of shoppers who stopped nearby (N_stop) was divided by the number who passed within the shelf’s visible area (N_pass), as follows:
ARₖ = (N_stop,k / N_pass,k) × 100
A stop was defined as a decline in speed to v ≤ 0.2 m/s for at least t ≥ 2 s.
(b) Behavioral engagement depth (DT). Continuous mean dwell time was measured within the active contact zone of each shelf (less than 0.6 m). The results for different store zones are shown below.
Zone type / shelf position | Total passersby (Npass) | Number stopping (Nstop) | Attractiveness rate (AR%) | Mean dwell time (s) | Standard deviation (SD) |
|---|---|---|---|---|---|
Aisle end-caps | 2,450 | 942 | 38.4% | 8.45 | 2.14 |
Middle shelves (eye level: 120–160 cm) | 2,100 | 748 | 35.6% | 7.82 | 1.95 |
Standard longitudinal shelves (overall) | 2,890 | 498 | 17.2% | 3.80 | 1.02 |
Lower shelf tiers (below 60 cm) | 2,100 | 180 | 8.6% | 2.15 | 0.68 |
Mid-aisle promotion and sale tables | 1,680 | 514 | 30.6% | 6.10 | 1.80 |
To test whether eye-level and lower shelves differed in dwell time, an independent-samples t-test was conducted.
Dependent variable | Shelf position | Number (N) | Mean (M) | Standard deviation (SD) | t statistic | Degrees of freedom (df) | Significance (p) | Cohen’s effect size (d) |
|---|---|---|---|---|---|---|---|---|
Dwell time (s) | Eye level | 748 | 7.82 | 1.95 | 14.82 | 926 | <0.001 | 1.28 |
Dwell time (s) | Lower shelf | 180 | 2.15 | 0.68 | - | - | - | - |
As Table 2 shows, shopper dwell time at eye level was significantly higher than at lower shelf levels. Cohen’s d indicated a very large effect; on average, shoppers spent approximately 3.6 times longer at eye-level shelves than at bottom shelves. Several parenthetical numerical expressions in the original narrative are left blank, but the corresponding values are reported in Table 2.
Stage 4: Customer behavior in checkout queues and checkout friction. Time spent in the checkout zone was observed as an indicator of friction and potential dissatisfaction. The results for 2,840 customers who reached payment are reported below.
No. | Behavioral variables | Mean (M) | Standard deviation (SD) | 1 | 2 | 3 |
|---|---|---|---|---|---|---|
1 | Waiting and payment time (s) | 126.40 | 43.80 | 1 | — | — |
2 | Friction-related behavior and queue abandonment | 0.31 | 0.14 | **0.54 | 1 | — |
3 | Impulse-product engagement and purchasing in queue | 0.24 | 0.11 | **0.42 | −0.18 | 1 |
According to Table 3, total mean checkout waiting and payment time was 126.40 seconds (SD = 43.80). Pearson correlations showed a significant positive association between queue delay and friction-related actions, such as shifting in place, motor restlessness, temporarily leaving, or abandoning the queue (r = 0.54, p < 0.01), particularly beyond 90 seconds. Waiting time was also positively associated with visual engagement with impulse-purchase shelves adjacent to checkout stations (r = 0.42, p < 0.01). The source states that each additional 30 seconds of waiting could increase attention to and purchase of impulse items by up to 18%, provided that total waiting time remained below the critical threshold of 180 seconds.
Stage 5: Associations between computer-vision indicators and behavioral loyalty. Finally, movement-track data for loyalty-card holders (N = 640) were matched to their purchase frequency. Multiple linear regression was used to predict repeat purchasing from environmental behavioral variables.
Predictor (independent) variable | Unstandardized coefficient (B) | Standard error (SE) | Standardized coefficient (β) | t statistic | Significance (p) |
|---|---|---|---|---|---|
Intercept (constant) | 1.42 | 0.21 | — | 6.76 | <0.001 |
Total dwell time | 0.18 | 0.04 | 0.22 | 4.50 | <0.001 |
Store spatial coverage ratio | 2.85 | 0.32 | 0.41 | 8.91 | <0.001 |
Checkout delay and waiting time | −0.36 | 0.11 | −0.28 | −3.27 | 0.002 |
Overall model fit indicators:
R = 0.678; R² = 0.460; adjusted R² = 0.457; F(3, 636) = 180.50; p < 0.001.
Standardized coefficients indicated that store spatial coverage ratio was the strongest positive predictor of behavioral loyalty (β = 0.41, p < 0.001), implying that customers who explored more store zones tended to purchase more frequently during subsequent periods. Total dwell time also had a positive significant association with repeat purchases (β = 0.22, p < 0.001). In contrast, checkout delay was negatively associated with repeat purchases (β = −0.28, p = 0.002), highlighting the adverse role of checkout friction in long-term loyalty.
Discussion
This study examined the feasibility of objectively analyzing shopper behavior in an operational retail store. Computer vision and image processing were used to extract motion patterns, stopping behavior, shelf interactions, and checkout queue behavior. The results showed that image-based observations can go beyond customer counts and movement maps to produce measures associated with attention, behavioral engagement, spatial discoverability, and behavioral loyalty. Image processing can therefore connect observed in-store behavior to managerial and marketing decisions.
Movement analysis revealed reduced customer walking speed upon entering principal aisles and encountering shelves. This change may indicate a transition from spatial navigation to environmental inspection and visual information processing. This interpretation is consistent with Zahedi Noghabi et al. (2022), who related cognitive processes to gaze and attention patterns (Zahedi Noghabi et al., 2022). Homayounfar et al. (2023) and Shirkhodaei et al. (2023) likewise emphasized visual stimuli in emotional activation and mental processing (Homayounfar et al., 2022). The present study extends these issues from laboratory environments to an operational store and suggests that changes in movement can function as behavioral signs of exposure to environmental cues. The result is also consistent with Yang et al. (2025) and Nguyen et al. (2024), who used movement paths and stopping points to study in-store customer behavior (Nguyen et al., 2024; Yang et al., 2025).
The shelf results indicated an association between product placement and height and the frequency and duration of shopper stops. Eye-level shelves and aisle end-caps attracted more engagement, whereas lower tiers and standard longitudinal shelving showed less behavioral engagement. This is in line with Kimasi and Khoshnevis (2021) on visual properties and attention and with Liu et al. (2016) and Paolanti et al. (2020) on shelf interaction (Kimasi & Khoshnevis, 2021; Liu et al., 2017; Paolanti et al., 2020). Those studies show that stopping and product engagement can help distinguish ordinary movement through space from meaningful product interest. Nevertheless, stopping and dwell time alone do not demonstrate visual attention or purchase intention; they should be interpreted as approximate behavioral proxies rather than direct measurements of cognition.
Spatial heat maps also showed that customer presence was unevenly distributed and that some parts of the floor were rarely visited. Identifying these regions can inform layout revisions and improved aisle discoverability. This observation agrees with Andalib et al. (2023), concerning spatial design and environmental stimuli, and Yaghoubi et al. (2021), concerning spatial interactions. It is also related to Zangana (2025) and Ganokratanaa et al. (2024), who discussed heat maps for identifying low-traffic locations and improving store organization (Andalib et al., 2022; Ganokratanaa et al., 2024; Yaghoubi et al., 2021; Zangana, 2025). Occupancy mapping thus helps managers recognize which parts of a store receive limited exposure or traffic; nevertheless, explanations for low traffic should also account for layout, merchandise assortment, signs, and route characteristics.
The checkout findings presented a dual picture of waiting time. Longer waits were associated with greater friction and restlessness, but queue time could also increase exposure to merchandise displayed near payment stations. This is consistent with discussions of impulse purchasing and environmental influences, including Safinia and Ghavami (2024) (Safinia & Ghavami, 2024). However, the result should not be interpreted as support for longer queues: exposure to nearby merchandise does not necessarily produce purchases and can coincide with deterioration in customer experience. Queue management should therefore balance exposure to complementary items against the prevention of friction and dissatisfaction.
In the behavioral loyalty model, store spatial coverage had the strongest positive association with repeat purchases. Total dwell time was also positively associated with repurchasing, whereas checkout delay had a negative association. These patterns suggest that broader exploration of the store is associated with more frequent return visits and that payment-stage friction may relate inversely to repeat purchasing. The findings correspond to Alfian et al. (2019), who used behavioral data to examine conversion, and to Kouhzadi et al. (2022) and Kazemi and Sadatian (2025), who emphasized combining behavioral traces with analytical and CRM systems (Alfian et al., 2019; Kazemi & Sadatian, 2025; Kouhzadi et al., 2022). Compared with transaction-only studies such as Beshardoust and Asgharizadeh (2023), the findings highlight the value of pre-purchase and in-store navigation data. However, the regression establishes statistical associations rather than causal effects. Shopping missions, product assortment, customer characteristics, and overall store experience may also contribute to these relationships.
Methodologically, this study illustrates the application of computer vision to measuring customer behavior under natural retail conditions. Such methods can help address the limitations of self-reports and exclusively transactional records by providing information on movement trajectories, stops, and spatial distribution. This approach aligns with international work on in-store tracking and behavior analysis, including Liciotti et al. (2017), Paolanti et al. (2020), and Narvilas et al. (2022) (Liciotti et al., 2016; Narvilas et al., 2022; Paolanti et al., 2020). Nevertheless, interpretation depends on reliable detection and tracking, camera calibration, illumination, occlusion, and clearly defined behavioral metrics. Privacy protection, limits on retained data, and transparent communication about video-based monitoring must also be core requirements.
Overall, trajectories, stopping points, shelf interactions, and checkout behavior can provide a more detailed account of the shopping experience and inform evidence-based decisions about merchandising, space management, and payment processes. The key advantage lies in observing actual behavior in natural conditions and comparing patterns across store zones. Image-based indicators should nevertheless be interpreted alongside sales records, loyalty data, and supplementary evaluations to avoid overstating cognitive or causal interpretations of observed actions.
Recommendations
Store managers are advised to use heat maps and dwell-time indicators to identify low-traffic sections, reconsider store layout, and improve route signage. In view of the observed differences across shelf positions, product placement should be reviewed in relation to commercial objectives, product category, and desired visibility, rather than placing every product at the same shelf height or position. Checkout waiting times and customers’ behavioral signals should be monitored continuously so that exposure to complementary merchandise is maintained without increasing restlessness or undermining shopping experience.
Future studies should combine image-derived information with transactional records and CRM systems to investigate more accurately the relationship between store exploration, actual purchases, and customer return behavior. Studies across stores with varying sizes, layouts, and product categories could assess generalizability. Subsequent research should validate image-derived indicators using human observation or complementary instruments and examine the roles of shopping mission, crowding, and environmental characteristics. In all such applications, shopper privacy, minimization of identifiable data, and transparency in collection and processing should remain fundamental principles.
Authors’ Contributions
All authors equally contributed to this study.
Declaration
In order to correct and improve the academic writing of our paper, we have used the language model ChatGPT.
Transparency Statement
Data are available for research purposes upon reasonable request to the corresponding author.
Acknowledgments
We would like to express our gratitude to all individuals helped us to do the project.
Declaration of Interest
The authors report no conflict of interest.
Funding
According to the authors, this article has no financial support.
Ethics Considerations
The study protocol adhered to the principles outlined in the Helsinki Declaration, which provides guidelines for ethical research involving human participants.
References
- Alfian, G., Ijaz, M. F., Syafrudin, M., Syaekhoni, M. A., Fitriyani, N. L., & Rhee, J. (2019). Customer behavior analysis using real-time data processing: A case study of digital signage-based online stores. Asia Pacific Journal of Marketing and Logistics, 31(1), 265-290. doi 10.1108/APJML-03-2018-0088
- Alipio, M. I., Peñalosa, K. M. T., & Unida, J. R. C. (2023). In-store customer traffic and path monitoring in small-scale supermarket using UWB-based localization and SSD-based detection. Journal of Ambient Intelligence and Humanized Computing, 14(5), 4955-4969. doi 10.1007/s12652-020-02236-z
- AlZahrani, Y. (2026). Smart video data processing in smart stores using IoT: Challenges and opportunities. In New Trends and Applications in Internet of Things (IoT) and Big Data Analytics (Vol. 2, pp. 41-54). doi 10.1007/978-3-032-21753-0_3
- Andalib, A., Ghorbani Dinani, H., & Naderi Bani, M. (2022). Designing a customer purchasing behavior analysis model under the influence of environmental sensory stimuli, with an emphasis on sensory marketing: A coffee-shop case study. doi 10.48308/jbmp.2024.232132.1523
- Beshardoust, O., & Asgharizadeh, E. (2022). Discovering customer purchasing behavior patterns using a combination of clustering and association rules (case study: detergents and hygiene products). Advertising and Sales Management. doi 10.22034/asm.2023.706598
- Cameron, L. D., Conzon, V., & Lam, L. (2025). Selling the self: Neo-normative control and the platform paradox. Research in Organizational Behavior, 100230. doi 10.1016/j.riob.2025.100230
- Castilla, D., Del Tejo Catalá, O., Pons, P., Signol, F., Rey, B., Suso-Ribera, C., & Perez-Cortes, J. C. (2024). Improving the understanding of web user behaviors through machine learning analysis of eye-tracking data. User Modeling and User-Adapted Interaction, 34(2), 293-322. doi 10.1007/s11257-023-09373-y
- Elhoseny, M., Lydia, E. L., Sree, S. R., Akhmetshin, E., & Shankar, K. (2025). Lightweight convolutional neural network-based computer vision model for human behavior analysis on consumer Internet of Things devices. IEEE Transactions on Consumer Electronics, 71(2), 5645-5652. doi 10.1109/TCE.2025.3564127
- Ganokratanaa, T., Ketcham, M., Pramkeaw, P., Chumuang, N., & Yimyam, W. (2024). Vision-based consumer behavior analysis system for retail optimization 2024 IEEE/ACM 17th International Conference on Utility and Cloud Computing (UCC),
- Garrido-Moreno, A., Martín-Rojas, R., & García-Morales, V. J. (2024). The key role of innovation and organizational resilience in improving business performance: A mixed-methods approach. International Journal of Information Management, 77, 102777. doi 10.1016/j.ijinfomgt.2024.102777
- Generosi, A., Ceccacci, S., & Mengoni, M. (2018). A deep learning-based system to track and analyze customer behavior in retail store 2018 IEEE 8th International Conference on Consumer Electronics-Berlin (ICCE-Berlin),
- Gerami, M., Mobin, A., Hashempour, R., & Yazdanian, V. (2022). Analysis of user behavior in online stores using deep learning. Law Enforcement Information and Communication Technology, 4(13). https://www.sid.ir/paper/1368901/en
- Ghazvini, S. N., Nazari, E., Salleh, N. Z. M., & Baharun, R. (2024). The Role and Application of Artificial Intelligence in Neuromarketing Research Based on Electroencephalography. International Journal of Academic Research in Business and Social Sciences, 14(12), 1556-1567. doi 10.6007/IJARBSS/v14-i12/24111
- Homayounfar, M., Fadaei, M., Soufi, M., & Pishehvarzad, O. (2022). Examining the relationship of advertising-message recall with visual and auditory emotions using a neuromarketing approach. doi 10.22034/cbsj.2023.62782
- Kazemi, M. A., & Sadatian, A. (2025). Designing a personalized financial recommender system based on customers' digital behavioral profiles. Smart Financial Management, 1(1), 45-57. doi 10.25843/JIFM.2025.8563.23585
- Kimasi, M., & Khoshnevis, M. (2021). Customer behavior analysis through measurement of users' visual attention to website banner advertising. Consumer Behavior Studies, 8(1), 22-37. doi 10.34785/J018.2021.489
- Knof, M., Stock-Homburg, R., & Schurer, J. (2024). How in-store sensor technologies can help retailers to understand their customers: overview on two decades of research. The International Review of Retail, Distribution and Consumer Research, 34(3), 381-398. doi 10.1080/09593969.2023.2273256
- Kostyal, D. S., Pistrui, B., & Matyusz, Z. (2026). Retail innovation in Central-Eastern Europe: A mixed-methods exploration of executive and consumer perspectives. Journal of Innovation & Knowledge, 17, 101056. doi 10.1016/j.jik.2026.101056
- Kouhzadi, F., Gharehbeiglou, H., Boudaghi Khajehnobar, H., & Alavi Matin, Y. (2022). Developing a big-data-based customer behavior analysis model using meta-synthesis and Delphi. doi 10.34785/J018.2022.718
- Laskar, M. R., Chowdhury, M. H., & Akter, M. (2025). Image processing and artificial intelligence in business automation: A review. Control Systems and Optimization Letters, 3(3), 280-287. https://ejournal.csol.or.id/index.php/csol/article/view/221
- Lemmens, A., Roos, J. M., Gabel, S., Ascarza, E., Bruno, H. A., Gordon, B. R., & Netzer, O. (2026). Personalization and targeting: how to experiment, learn & optimize. International Journal of Research in Marketing, 43(2), 537-559. doi 10.1016/j.ijresmar.2025.07.004
- Li, R., Wang, W., Ghose, A., Li, B., & Xu, K. (2023). Predicting Consumer In-Store Purchase through Real-Time Video Analytics: An Advanced Computer Vision and Deep Learning Approach. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4513385
- Liciotti, D., Frontoni, E., Mancini, A., & Zingaretti, P. (2016). Pervasive system for consumer behaviour analysis in retail environments International Workshop on Video Analytics for Audience Measurement in Retail and Digital Signage,
- Liu, J., Gu, Y., & Kamijo, S. (2017). Customer behavior classification using surveillance camera for marketing. Multimedia Tools and Applications, 76(5), 6595-6622. doi 10.1007/s11042-016-3342-1
- Memon, M., Talpur, S., Narejo, S., Channa, A., & Pandey, J. K. (2026). Fundamentals of image processing for surveillance. In Computational Intelligence in Surveillance Systems Using Image Processing (pp. 13-24). Elsevier. doi 10.1016/B978-0-443-36408-2.00010-2
- Narvilas, G., Urbonas, V., & Butkevičiūtė, E. (2022). Human's behavior tracking in a store using multiple security cameras. Baltic Journal of Modern Computing, 10(3), 526-544. doi 10.22364/bjmc.2022.10.3.24
- Nazari Ghazvini, S., Vakil Alroaia, Y., & Baharun, R. B. (2026). Physiological Response Evaluation of Consumers to Brands During Purchase Decision-Making Using Electroencephalography: A Study on Caffeinated Beverages in Malaysia and Iran. Interdisciplinary Journal of Management Studies, 19(4), 753-770. doi 10.22059/ijms.2025.382106.677013
- Nazari, G. S., Vakil, A. Y., & Baharon, R. B. (2023). The Study of Electroencephalography in Neuromarketing Research, Consumer Behavior and Performance Method: A Systematic Analysis. doi 10.30495/jsm.2023.1983505.1805
- Nguyen, T. D., Hihara, K., Hoang, T. C., Utada, Y., Torii, A., Izumi, N., & Tran, L. Q. (2024). Retail store customer behavior analysis system: Design and implementation IFIP International Conference on Artificial Intelligence Applications and Innovations,
- Paolanti, M., Pietrini, R., Mancini, A., Frontoni, E., & Zingaretti, P. (2020). Deep understanding of shopper behaviours and interactions using RGB-D vision. Machine Vision and Applications, 31(7), 66. doi 10.1007/s00138-020-01118-w
- Rastogi, I., Sinha, U., & Gaur, A. (2024). Image processing in retail marketing: Innovations for customer engagement, sales, and operational efficiency International Conference on Recent Trends in Computing,
- Rodrigues, R. I., Lopes, P., & Varela, M. (2021). Factors Affecting Impulse Buying Behavior of Consumers. Frontiers in Psychology, 12, 697080. doi 10.3389/fpsyg.2021.697080
- Safinia, A. M., & Ghavami, M. (2024). An investigation of Internet of Things applications in analyzing consumer behavior in emotional purchases using artificial intelligence. Smart Marketing Management, 5(1), 105-125. doi 10.22034/JABM.3.2.15564.351256.3543.45
- Salih, S., Husain, O., Almohamedh, R. M., Hashim, A. H. A., Elshafie, H., & Motwakel, A. (2025). From Ideation to Execution: Unleashing the Power of Generative AI in Modern Digital Marketing and Customer Engagement-A Systematic Literature Review and Case Study. Array, 100630. doi 10.1016/j.array.2025.100630
- Shirkhodaei, M., Ghorbani Manghari, Z., Namdar Tajari, S., & Hosseini, A. (2023). The effect of an audio logo on brand recognition based on the electrical activity of the cerebral cortex. Strategic Management Thought, 17(4). doi 10.30497/smt.2024.246198.3565
- Theocharis, D., Tsekouropoulos, G., Chatzigeorgiou, C., & Kokkinis, G. (2025). Empirical Categorization of Factors Affecting Online Consumer Behavior of Gen Z Regarding Newly Launched Technological Products and Moderating Impact of Perceived Risk. Behavioral Sciences, 15(3), 371. doi 10.3390/bs15030371
- Wen, J., Guillen, L., Abe, T., & Suganuma, T. (2021). A hierarchy-based system for recognizing customer activity in retail environments. Sensors, 21(14), 4712. doi 10.3390/s21144712
- Yaghoubi, Z., Al-e-Sheikh, A. A., & Abbasi, O. R. (2021). Analyzing retail customers' behavior using spatial interaction models: A case study of pastry shops in Tehran. doi 10.22131/sepehr.2021.246144
- Yang, S. R., Chang, Y. H., & Chen, C. Y. (2025). Customer flow and behavior analysis using YOLO, DeepSORT, and computational geometry algorithms Second International Conference on Advanced Robotics, Automation Engineering, and Machine Learning (ARAEML 2025),
- Zahedi Noghabi, M., Fattahi, R., Salehi Fardi, J., & Nowkarizi, M. (2022). Analysis of users' eye movements and the role of their abilities when interacting with website user interfaces. doi 10.35050/JIPM010.2022.285
- Zangana, H. (2025). Object detection and visual intelligence in retail environments: A deep learning approach for inventory and behavior analytics. Intelligent Methods In Engineering Sciences, 4(2), 22-28. doi 10.58190/imiens.2025.124