lnu.sePublications
Operational message
There are currently operational disruptions. Troubleshooting is in progress.
Change search
Link to record
Permanent link

Direct link
Martins, Rafael Messias, Dr.ORCID iD iconorcid.org/0000-0002-2901-935X
Publications (10 of 60) Show all publications
Holm, I., Martins, R. M., Linhares, C. D. G. & Soares, A. (2026). VILOD: Combining Visual Interactive Labeling With Active Learning for Object Detection. IEEE Computer Graphics and Applications
Open this publication in new window or tab >>VILOD: Combining Visual Interactive Labeling With Active Learning for Object Detection
2026 (English)In: IEEE Computer Graphics and Applications, ISSN 0272-1716, E-ISSN 1558-1756Article in journal (Refereed) Epub ahead of print
Abstract [en]

The need for large, high-quality annotated datasets continues to represent a primary limitation in training Object Detection (OD) models. To mitigate this challenge, we present VILOD, a Visual Interactive Labeling tool that integrates Active Learning (AL) with a suite of interactive visualizations to create an effective Human-in-the-Loop (HITL) workflow for OD annotation and training. VILOD is designed to make the AL process more transparent and steerable, empowering expert users to implement diverse, strategically guided labeling strategies that extend beyond algorithmic query strategies. Through comparative case studies, we evaluate three visually guided labeling strategies against a conventional automated AL baseline. The results show that a balanced, human-guided strategy—leveraging VILOD's visual cues to synthesize information about data structure and model uncertainty—not only outperforms the automated baseline but also achieves the highest overall model performance. These findings emphasize the potential of visually guided, interactive annotation to enhance both the efficiency and effectiveness of dataset creation for OD.

Place, publisher, year, edition, pages
IEEE, 2026
Keywords
Labeling, Visualization, Object detection, Data visualization, Annotations, Data models, Training, Uncertainty, Computational modeling, Adaptation models
National Category
Artificial Intelligence Human Computer Interaction Computer Sciences
Research subject
Computer Science, Information and software visualization
Identifiers
urn:nbn:se:lnu:diva-144734 (URN)10.1109/mcg.2026.3660508 (DOI)
Available from: 2026-02-04 Created: 2026-02-04 Last updated: 2026-02-09
Cui, W., Afzal, S., Martins, R. M., Ghani, S. & Hoteit, I. (2025). ColorPCA: Scalable Colored Dimensionality Reduction for Unlabeled High-Dimensional Data. IEEE Access, 13, 98037-98054
Open this publication in new window or tab >>ColorPCA: Scalable Colored Dimensionality Reduction for Unlabeled High-Dimensional Data
Show others...
2025 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 13, p. 98037-98054Article in journal (Refereed) Published
Abstract [en]

Mapping labeled high-dimensional data to colors based on class labels in low-dimensional projections is effective for enhancing pattern recognition and reducing misinterpretation of clusters. However, automatic coloring of unlabeled high-dimensional data remains challenging for revealing unknown patterns or class structures in the data. To address this, we propose ColorPCA, a scalable method that improves existing dimensionality reduction-based automatic coloring by integrating Principal Component Analysis with alpha compositing. Rather than mapping reduced dimensions to color coordinates, ColorPCA directly encodes data into color space to enhance pattern discovery in unlabeled datasets. We implemented ColorPCA in a web-based visual analytics system for interactive exploration and evaluated it through three case studies using benchmark, simulated, and real-world climate datasets. Additionally, we conducted three user studies, two with generic users and one with climate domain experts. Comparisons with two state-of-the-art coloring methods based on PCA and t-SNE demonstrate that ColorPCA improves visual separability and facilitates deeper insight extraction in high-dimensional data visualization.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
image color analysis, principal component analysis, data visualization, high dimensional data, dimensionality reduction, visual analytics, meteorology, geology, gaussian distribution, encoding, high-dimensional data, dimensionality reduction, color mapping, color contrast enhancement, unlabeled data, data visualization, climate visualization
National Category
Computer Sciences
Identifiers
urn:nbn:se:lnu:diva-140802 (URN)10.1109/access.2025.3575955 (DOI)001506741800009 ()2-s2.0-105007473613 (Scopus ID)
Available from: 2025-07-14 Created: 2025-07-14 Last updated: 2025-08-04Bibliographically approved
Othman, R., Powley, B., Martins, R. M., Soares, A., Kerren, A., Ferreira, N. & Linhares, C. D. G. (2025). Fairness-Aware Urban Planning in Sweden: An Interactive Visualization Tool for Equitable Cities. In: : . Paper presented at EuroVis 2025.
Open this publication in new window or tab >>Fairness-Aware Urban Planning in Sweden: An Interactive Visualization Tool for Equitable Cities
Show others...
2025 (English)Conference paper, Poster (with or without abstract) (Refereed)
Abstract [en]

This study presents an interactive visualization tool that facilitates fairness-aware urban planning. The system introduces afairness scale to assess the accessibility of potential new developments, using color-coded scatter plots to visualize disparities.An intuitive interaction design minimizes complexity while enhancing usability, enabling users to analyze urban infrastructureand services. Developed with web technologies, the tool leverages OpenStreetMap data to ensure adaptability across differentcities. Future optimizations include advanced analytical capabilities and broader dataset integrations to improve decision-making in urban development.

National Category
Computer and Information Sciences Social and Economic Geography
Identifiers
urn:nbn:se:lnu:diva-139677 (URN)10.2312/evp.20251141 (DOI)
Conference
EuroVis 2025
Available from: 2025-06-17 Created: 2025-06-17 Last updated: 2025-09-02Bibliographically approved
Marcilio-Jr, W. E., Eler, D. M., Paulovich, F. V. & Martins, R. M. (2025). HUMAP: Hierarchical Uniform Manifold Approximation and Projection. IEEE Transactions on Visualization and Computer Graphics, 31(9), 5741-5753
Open this publication in new window or tab >>HUMAP: Hierarchical Uniform Manifold Approximation and Projection
2025 (English)In: IEEE Transactions on Visualization and Computer Graphics, ISSN 1077-2626, E-ISSN 1941-0506, Vol. 31, no 9, p. 5741-5753Article in journal (Refereed) Published
Abstract [en]

Dimensionality reduction (DR) techniques help analysts to understand patterns in high-dimensional spaces. These techniques, often represented by scatter plots, are employed in diverse science domains and facilitate similarity analysis among clusters and data samples. For datasets containing many granularities or when analysis follows the information visualization mantra, hierarchical DR techniques are the most suitable approach since they present major structures beforehand and details on demand. This work presents HUMAP, a novel hierarchical dimensionality reduction technique designed to be flexible on preserving local and global structures and preserve the mental map throughout hierarchical exploration. We provide empirical evidence of our technique's superiority compared with current hierarchical approaches and show a case study applying HUMAP for dataset labelling.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
dimensionality reduction, hierarchical explora-tion, manifold learning, manifold learning
National Category
Computer Sciences
Research subject
Computer and Information Sciences Computer Science, Computer Science
Identifiers
urn:nbn:se:lnu:diva-141133 (URN)10.1109/tvcg.2024.3471181 (DOI)001542452400039 ()39348254 (PubMedID)2-s2.0-85205939462 (Scopus ID)
Available from: 2025-08-19 Created: 2025-08-19 Last updated: 2025-09-01Bibliographically approved
Larkina, K., Holomsha, O., Lemos, L., Soares, A., Martins, R. M., Kerren, A., . . . Linhares, C. D. G. (2025). Visualizing Communities in Dynamic Multivariate Networks. In: Felipe de Castro Belém (Ed.), 2025 38th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI): September 30th - October 3rd, 2025, Salvador, Brazil: Proceedings. Paper presented at 2025 38th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Salvador, Brazil, September 30 - October 3, 2025. IEEE
Open this publication in new window or tab >>Visualizing Communities in Dynamic Multivariate Networks
Show others...
2025 (English)In: 2025 38th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI): September 30th - October 3rd, 2025, Salvador, Brazil: Proceedings / [ed] Felipe de Castro Belém, IEEE, 2025Conference paper, Published paper (Refereed)
Abstract [en]

A dynamic (or temporal) network is a widely used structure that enables understanding dynamic systems by modeling interactions among system components over time. In many real-world cases, however, components (called nodes) and/or interactions (called edges) contain numerous meaningful attributes, leading to the need for a more suitable instrument for representing and analyzing these dynamic and complex systems with multiple attributes: the Dynamic Multivariate Network (DMVN). In this work, we extended LargeNetVis, a visualization system specifically designed for large dynamic networks that focus on network community structure and dynamics, to enable the visual exploration of DMVNs and their communities. The newly introduced visual encodings and interactions allow the visualization of nodes' and edges' attributes at different granularity levels and produce a node tracking capability from both top-down and bottom-up perspectives. With these functionalities, one can track individual nodes across dynamic communities over time. The proposed approach is validated by comparing it with the original LargeNetVis system and conducting a user evaluation involving 37 participants.

Place, publisher, year, edition, pages
IEEE, 2025
Series
Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI), ISSN 1530-1834, E-ISSN 2377-5416
Keywords
Visualization, Instruments, Encoding, Dynamical systems, Complex systems
National Category
Computer Sciences
Research subject
Computer and Information Sciences Computer Science, Computer Science
Identifiers
urn:nbn:se:lnu:diva-142451 (URN)10.1109/sibgrapi67909.2025.11223378 (DOI)2-s2.0-105025123661 (Scopus ID)9798331589516 (ISBN)9798331589523 (ISBN)
Conference
2025 38th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Salvador, Brazil, September 30 - October 3, 2025
Available from: 2025-11-12 Created: 2025-11-12 Last updated: 2026-01-21Bibliographically approved
Giussani, S., Martins, R. M., Soares, A., Caporuscio, M. & Perez-Palacin, D. (2025). Visualizing Feature Importance of Time Series Data in Discrete-Event Simulations using Shapley Additive Explanations. In: Proceedings of the 39th ACM SIGSIM Conference on Principles of Advanced Discrete Simulation: . Paper presented at SIGSIM-PADS '25 (pp. 65-69). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Visualizing Feature Importance of Time Series Data in Discrete-Event Simulations using Shapley Additive Explanations
Show others...
2025 (English)In: Proceedings of the 39th ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, Association for Computing Machinery (ACM) , 2025, p. 65-69Conference paper, Published paper (Refereed)
Abstract [en]

As simulation applications become vital for understanding and predicting complex systems, analyzing data from repeated simulation runs is essential to gauge model uncertainty and identify optimal parameter settings. This paper presents a visualization tool for analyzing time series ensemble data generated by discrete-event simulations, focusing on feature importance within clustering results. The tool combines dimensionality reduction, clustering, and SHapley Additive exPlanations (SHAP) to highlight influential features and identify trends within clustered simulation data, advancing previous approaches focusing solely on visualization or clustering without analyzing specific feature contributions. By analyzing a manufacturing use case, we show how the visualization supports decision-makers by depicting the main features driving cluster formation and displaying time intervals critical to characterizing distinct system behaviors.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2025
Keywords
Ensemble Data Analysis, Feature-Based Clustering, Simulation Visualization
National Category
Computer Sciences
Research subject
Computer and Information Sciences Computer Science, Computer Science
Identifiers
urn:nbn:se:lnu:diva-140235 (URN)10.1145/3726301.3728401 (DOI)2-s2.0-105010602813 (Scopus ID)9798400715914 (ISBN)
Conference
SIGSIM-PADS '25
Available from: 2025-06-26 Created: 2025-06-26 Last updated: 2026-01-20Bibliographically approved
Hilasaca, G. M., Marcílio-Jr, W. E., Eler, D. M., Martins, R. M. & Paulovich, F. V. (2024). A Grid-based Method for Removing Overlaps of Dimensionality Reduction Scatterplot Layouts. IEEE Transactions on Visualization and Computer Graphics, 30(8), 5733-5749
Open this publication in new window or tab >>A Grid-based Method for Removing Overlaps of Dimensionality Reduction Scatterplot Layouts
Show others...
2024 (English)In: IEEE Transactions on Visualization and Computer Graphics, ISSN 1077-2626, E-ISSN 1941-0506, Vol. 30, no 8, p. 5733-5749Article in journal (Refereed) Published
Abstract [en]

Dimensionality Reduction (DR) scatterplot layouts have become a ubiquitous visualization tool for analyzing multidimensional datasets. Despite their popularity, such scatterplots suffer from occlusion, especially when informative glyphs are used to represent data instances, potentially obfuscating critical information for the analysis under execution. Different strategies have been devised to address this issue, either producing overlap-free layouts that lack the powerful capabilities of contemporary DR techniques in uncovering interesting data patterns or eliminating overlaps as a post-processing strategy. Despite the good results of post-processing techniques, most of the best methods typically expand or distort the scatterplot area, thus reducing glyphs’ size (sometimes) to unreadable dimensions, defeating the purpose of removing overlaps. This article presents Distance Grid (DGrid) , a novel post-processing strategy to remove overlaps from DR layouts that faithfully preserves the original layout's characteristics and bounds the minimum glyph sizes. We show that DGrid surpasses the state-of-the-art in overlap removal (through an extensive comparative evaluation considering multiple different metrics) while also being one of the fastest techniques, especially for large datasets. A user study with 51 participants also shows that DGrid is consistently ranked among the top techniques for preserving the original scatterplots’ visual characteristics and the aesthetics of the final results.

Place, publisher, year, edition, pages
IEEE, 2024
National Category
Computer Sciences
Research subject
Computer and Information Sciences Computer Science, Computer Science
Identifiers
urn:nbn:se:lnu:diva-126406 (URN)10.1109/tvcg.2023.3309941 (DOI)001262914400072 ()37647195 (PubMedID)2-s2.0-85169671474 (Scopus ID)
Available from: 2024-01-11 Created: 2024-01-11 Last updated: 2025-06-02Bibliographically approved
Mohseni, Z., Masiello, I. & Martins, R. M. (2024). A technical infrastructure for primary education data that contributes to data standardization. Education and Information Technologies: Official Journal of the IFIP technical committee on Education, 29, 21045-21061
Open this publication in new window or tab >>A technical infrastructure for primary education data that contributes to data standardization
2024 (English)In: Education and Information Technologies: Official Journal of the IFIP technical committee on Education, ISSN 1360-2357, E-ISSN 1573-7608, Vol. 29, p. 21045-21061Article in journal (Refereed) Published
Abstract [en]

There is a significant amount of data available about students and their learning activities in many educational systems today. However, these datasets are frequently spread across several different digital services, making it challenging to use them strategically. In addition, there are no established standards for collecting, processing, analyzing, and presenting such data. As a result, school leaders, teachers, and students do not capitalize on the possibility of making decisions based on data. This is a serious barrier to the improvement of work in schools, teacher and student progress, and the development of effective Educational Technology (EdTech) products and services. Data standards can be used as a protocol on how different IT systems communicate with each other. When working with data from different public and private institutions simultaneously (e.g., different municipalities and EdTech companies), having a trustworthy data pipeline for retrieving the data and storing it in a secure warehouse is critical. In this study, we propose a technical solution containing a data pipeline by employing a secure warehouse—the Swedish University Computer Network (SUNET), which is an interface for information exchange between operational processes in schools. We conducted a user study in collaboration with four municipalities and four EdTech companies based in Sweden. Our proposal involves introducing a data standard to facilitate the integration of educational data from diverse resources in our SUNET drive. To accomplish this, we created customized scripts for each stakeholder, tailored to their specific data formats, with the aim of merging the students’ data. The results of the first four steps show that our solution works. Once the results of the next three steps are in, we will contemplate scaling up our technical solution nationwide. With the implementation of the suggested data standard and the utilization of the proposed technical solution, diverse stakeholders can benefit from improved management, transportation, analysis, and visualization of educational data.

Place, publisher, year, edition, pages
Springer, 2024
Keywords
Data standard, Data pipeline, Secure data pipeline, Educational data, Primary education, Technical infrastructure, SUNET drive
National Category
Information Systems, Social aspects
Research subject
Computer and Information Sciences Computer Science, Information Systems
Identifiers
urn:nbn:se:lnu:diva-129073 (URN)10.1007/s10639-024-12683-2 (DOI)001208963600002 ()2-s2.0-85191712850 (Scopus ID)
Funder
Linnaeus University
Available from: 2024-04-28 Created: 2024-04-28 Last updated: 2025-02-11Bibliographically approved
Chatzimparmpas, A., Martins, R. M., Telea, A. C. & Kerren, A. (2024). DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumps. Computer graphics forum (Print), 43(6), Article ID e15004.
Open this publication in new window or tab >>DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumps
2024 (English)In: Computer graphics forum (Print), ISSN 0167-7055, E-ISSN 1467-8659, Vol. 43, no 6, article id e15004Article in journal (Refereed) Published
Abstract [en]

As the complexity of Machine Learning (ML) models increases and their application in different (and critical) domains grows, there is a strong demand for more interpretable and trustworthy ML. A direct, model-agnostic, way to interpret such models is to train surrogate models—such as rule sets and decision trees—that sufficiently approximate the original ones while being simpler and easier-to-explain. Yet, rule sets can become very lengthy, with many if-else statements, and decision tree depth grows rapidly when accurately emulating complex ML models. In such cases, both approaches can fail to meet their core goal—providing users with model interpretability. To tackle this, we propose DeforestVis, a visual analytics tool that offers summarization of the behavior of complex ML models by providing surrogate decision stumps (one-level decision trees) generated with the Adaptive Boosting (AdaBoost) technique. DeforestVis helps users to explore the complexity vs fidelity trade-off by incrementally generating more stumps, creating attribute-based explanations with weighted stumps to justify decision making, and analyzing the impact of rule overriding on training instance allocation between one or more stumps. An independent test set allows users to monitor the effectiveness of manual rule changes and form hypotheses based on case-by-case analyses. We show the applicability and usefulness of DeforestVis with two use cases and expert interviews with data analysts and model developers.

Place, publisher, year, edition, pages
John Wiley & Sons, 2024
Keywords
Surrogate model, model understanding, adaptive boosting, machine learning, visual analytics
National Category
Computer Sciences
Research subject
Computer Science, Information and software visualization
Identifiers
urn:nbn:se:lnu:diva-127909 (URN)10.1111/cgf.15004 (DOI)001174196500001 ()2-s2.0-85185930256 (Scopus ID)
Funder
ELLIIT - The Linköping‐Lund Initiative on IT and Mobile Communications
Available from: 2024-02-20 Created: 2024-02-20 Last updated: 2024-10-17Bibliographically approved
Mohseni, Z., Masiello, I., Martins, R. M. & Nordmark, S. (2024). Visual Learning Analytics for Educational Interventions in Primary and Secondary Schools: A Scoping Review. Journal of Learning Analytics, 11(2), 91-111
Open this publication in new window or tab >>Visual Learning Analytics for Educational Interventions in Primary and Secondary Schools: A Scoping Review
2024 (English)In: Journal of Learning Analytics, ISSN 1929-7750, Vol. 11, no 2, p. 91-111Article in journal (Refereed) Published
Abstract [en]

Visual Learning Analytics (VLA) uses analytics to monitor and assess educational data by combining visual and automated analysis to provide educational explanations. Such tools could aid teachers in primary and secondary schools in making pedagogical decisions, however, the evidence of their effectiveness and benefits is still limited. With this scoping review, we provide a comprehensive overview of related research on proposed VLA methods, as well as identifying any gaps in the literature that could assist in describing new and helpful directions to the field. This review searched all relevant articles in five accessible databases — Scopus, Web of Science, ERIC, ACM, and IEEE Xplore — using 40 keywords. These studies were mapped, categorized, and summarized based on their objectives, the collected data, the intervention approaches employed, and the results obtained. The results determined what affordances the VLA tools allowed, what kind of visualizations were used to inform teachers and students, and, more importantly, positive evidence of educational interventions. We conclude that there are moderate-to-clear learning improvements within the limit of the studies’ interventions to support the use of VLA tools. More systematic research is needed to determine whether any learning gains are translated into long-term improvements.

Place, publisher, year, edition, pages
Society for Learning Analytics Research (SoLAR), 2024
Keywords
Visual learning analytics, Learning analytics dashboard, Educational interventions, Primary school, Secondary school, Scoping review, Systematic review
National Category
Computer and Information Sciences Pedagogy
Research subject
Computer and Information Sciences Computer Science
Identifiers
urn:nbn:se:lnu:diva-131233 (URN)10.18608/jla.2024.8309 (DOI)001295934400006 ()2-s2.0-85202576381 (Scopus ID)
Available from: 2024-07-01 Created: 2024-07-01 Last updated: 2025-02-11Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-2901-935X

Search in DiVA

Show all publications

Profile pages