{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T09:04:11Z","timestamp":1773738251657,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2018,7,19]],"date-time":"2018-07-19T00:00:00Z","timestamp":1531958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Industry 4.0-based human-in-the-loop cyber-physical production systems are transforming the industrial workforce to accommodate the ever-increasing variability of production. Real-time operator support and performance monitoring require accurate information on the activities of operators. The problem with tracing hundreds of activity times is critical due to the enormous variability and complexity of products. To handle this problem a software-sensor-based activity-time and performance measurement system is proposed. To ensure a real-time connection between operator performance and varying product complexity, fixture sensors and an indoor positioning system (IPS) were designed and this multi sensor data merged with product-relevant information. The proposed model-based performance monitoring system tracks the recursively estimated parameters of the activity-time estimation model. As the estimation problem can be ill-conditioned and poor raw sensor data can result in unrealistic parameter estimates, constraints were introduced into the parameter-estimation algorithm to increase the robustness of the software sensor. The applicability of the proposed methodology is demonstrated on a well-documented benchmark problem of a wire harness manufacturing process. The fully reproducible and realistic simulation study confirms that the indoor positioning system-based integration of primary sensor signals and product-relevant information can be efficiently utilized in terms of the constrained recursive estimation of the operator activity.<\/jats:p>","DOI":"10.3390\/s18072346","type":"journal-article","created":{"date-parts":[[2018,7,20]],"date-time":"2018-07-20T02:10:11Z","timestamp":1532052611000},"page":"2346","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["Software Sensor for Activity-Time Monitoring and Fault Detection in Production Lines"],"prefix":"10.3390","volume":"18","author":[{"given":"Tamas","family":"Ruppert","sequence":"first","affiliation":[{"name":"MTA-PE \u201cLend\u00fclet\u201d Complex Systems Monitoring Research Group, Department of Process Engineering, University of Pannonia, Egyetem u. 10, POB 158, H-8200 Veszpr\u00e9m, Hungary"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8593-1493","authenticated-orcid":false,"given":"Janos","family":"Abonyi","sequence":"additional","affiliation":[{"name":"MTA-PE \u201cLend\u00fclet\u201d Complex Systems Monitoring Research Group, Department of Process Engineering, University of Pannonia, Egyetem u. 10, POB 158, H-8200 Veszpr\u00e9m, Hungary"}]}],"member":"1968","published-online":{"date-parts":[[2018,7,19]]},"reference":[{"key":"ref_1","unstructured":"Romero, D., Stahre, J., Wuest, T., Noran, O., Bernus, P., Fast-Berglund, \u00c5., and Gorecky, D. (2016, January 29\u201331). Towards an operator 4.0 typology: A human-centric perspective on the fourth industrial revolution technologies. Proceedings of the International Conference on Computers and Industrial Engineering (CIE46), Tianjin, China."},{"key":"ref_2","first-page":"1","article-title":"Implementing smart factory of industrie 4.0: An outlook","volume":"12","author":"Wang","year":"2016","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1016\/j.cie.2003.03.002","article-title":"Human related issues in manufacturing cell design, implementation, and operation: A review and survey","volume":"48","author":"Bidanda","year":"2005","journal-title":"Comput. Ind. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Roitberg, A., Perzylo, A., Somani, N., Giuliani, M., Rickert, M., and Knoll, A. (2014, January 9\u201312). Human activity recognition in the context of industrial human-robot interaction. Proceedings of the Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific, Siem Reap, Cambodia.","DOI":"10.1109\/APSIPA.2014.7041588"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Krahnstoever, N., Rittscher, J., Tu, P., Chean, K., and Tomlinson, T. (2005, January 5\u20137). Activity recognition using visual tracking and RFID. Proceedings of the 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV\/MOTION\u201905), Breckenridge, CO, USA.","DOI":"10.1109\/ACVMOT.2005.17"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/MPRV.2008.40","article-title":"Wearable activity tracking in car manufacturing","volume":"7","author":"Stiefmeier","year":"2008","journal-title":"IEEE Pervasive Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Koskimaki, H., Huikari, V., Siirtola, P., Laurinen, P., and Roning, J. (2009, January 24\u201326). Activity recognition using a wrist-worn inertial measurement unit: A case study for industrial assembly lines. Proceedings of the 2009 17th Mediterranean Conference on Control and Automation, Thessaloniki, Greece.","DOI":"10.1109\/MED.2009.5164574"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1109\/TPAMI.2006.197","article-title":"Activity recognition of assembly tasks using body-worn microphones and accelerometers","volume":"28","author":"Ward","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Huikari, V., Koskim\u00e4ki, H., Siirtola, P., and R\u00f6ning, J. (2010, January 1\u20133). User-independent activity recognition for industrial assembly lines-feature vs. instance selection. Proceedings of the 5th International Conference on Pervasive Computing and Applications, Maribor, Slovenia.","DOI":"10.1109\/ICPCA.2010.5704118"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1080\/08839514.2012.629540","article-title":"Improving multi-camera activity recognition by employing neural network based readjustment","volume":"26","author":"Voulodimos","year":"2012","journal-title":"Appl. Artif. Intell."},{"key":"ref_11","unstructured":"Faragher, R., and Faragher, R. (2014, January 8\u201312). An Analysis of the Accuracy of Bluetooth Low Energy for Indoor Positioning Applications. Proceedings of the 27th International Technical Meeting of the Satellite Division of the Institute of Navigation (ION GNSS+\u201914), Tampa, FL, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1109\/MSP.2005.1458289","article-title":"Localization via ultra-wideband radios: A look at positioning aspects of future sensor networks","volume":"22","author":"Gezici","year":"2005","journal-title":"IEEE Signal Proc. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4894","DOI":"10.1021\/ie9606597","article-title":"Parameter-constrained adaptive control","volume":"36","author":"Timmons","year":"1997","journal-title":"Ind. Eng. Chem. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/0925-5273(93)90033-H","article-title":"Activity-based cost tables to support wire harness design","volume":"29","author":"Ong","year":"1993","journal-title":"Int. J. Prod. Econ."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/BF02601438","article-title":"Assembly times for electrical connections and wire harnesses","volume":"6","author":"Ong","year":"1991","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1080\/07408170008967418","article-title":"Design of flexible assembly line to minimize equipment cost","volume":"32","author":"Bukchin","year":"2000","journal-title":"IIE Trans."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1057\/palgrave.jors.2601118","article-title":"Designing a Mixed-Model, Open-Station Assembly Line Using Mixed-Integer Programming","volume":"52","author":"Sarker","year":"2001","journal-title":"J. Oper. Res. Soc."},{"key":"ref_18","unstructured":"(2018, June 01). Assembly Line Conveyor Systems. Available online: https:\/\/www.pacline.com\/photos\/ photos-by-solution\/ assembly-line-conveyors\/."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1109\/TASE.2006.887160","article-title":"Design for Cost: Module-Based Mass Customization","volume":"4","author":"Agard","year":"2007","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1109\/TSMCC.2007.905750","article-title":"Survey of wireless indoor positioning techniques and systems","volume":"37","author":"Liu","year":"2007","journal-title":"IEEE Trans. Syst. Man Cybern. Part C"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Alarifi, A., Al-Salman, A., Alsaleh, M., Alnafessah, A., Al-Hadhrami, S., Al-Ammar, M.A., and Al-Khalifa, H.S. (2016). Ultra wideband indoor positioning technologies: Analysis and recent advances. Sensors, 16.","DOI":"10.3390\/s16050707"},{"key":"ref_22","unstructured":"Ingram, S., Harmer, D., and Quinlan, M. (2004, January 26\u201329). Ultrawideband indoor positioning systems and their use in emergencies. Proceedings of the PLANS 2004. Position Location and Navigation Symposium (IEEE Cat. No. 04CH37556), Monterey, CA, USA."},{"key":"ref_23","unstructured":"Lai, Z., Joshi, H., Goeckel, D., Gupta, D., Gupta, D., and Mathew, A. (2008, January 10\u201312). Performance of UWB systems in the presence of severe multipath and narrowband interference. Proceedings of the 2008 IEEE International Conference on Ultra-Wideband, Hannover, Germany."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gigl, T., Janssen, G.J., Dizdarevic, V., Witrisal, K., and Irahhauten, Z. (2007, January 22). Analysis of a UWB indoor positioning system based on received signal strength. Proceedings of the 2007 4th Workshop on Positioning, Navigation and Communication, Hannover, Germany.","DOI":"10.1109\/WPNC.2007.353618"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1080\/09537289608930357","article-title":"A Decision Support Tool for Planning Bills of Material","volume":"7","author":"Cunningham","year":"1996","journal-title":"Prod. Plan. Control"},{"key":"ref_26","first-page":"411","article-title":"Using Value Stream Mapping to Analyze an Upholstery Furniture Engineering Process","volume":"61","author":"Wang","year":"2011","journal-title":"For. Prod. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1252","DOI":"10.1109\/TII.2014.2306771","article-title":"Internet of Things and BOM-Based life cycle assessment of energy-saving and emission-reduction of products","volume":"10","author":"Tao","year":"2014","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Raol, J.R. (2009). Multi-Sensor Data Fusion with MATLAB\u00ae, CRC Press.","DOI":"10.1201\/9781439800058"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2192","DOI":"10.1109\/TIT.2003.815774","article-title":"Optimal linear estimation fusion. I. Unified fusion rules","volume":"49","author":"Li","year":"2003","journal-title":"IEEE Trans. Inform. Theory"},{"key":"ref_30","unstructured":"Young, P.C. (2012). Recursive Estimation and Time-Series Analysis: An Introduction, Springer Science & Business Media."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1002\/aic.690340403","article-title":"Recursive identification of gross errors in linear data reconciliation","volume":"34","author":"Crowe","year":"1988","journal-title":"AIChE J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1712","DOI":"10.1002\/aic.690410711","article-title":"Detection of gross erros in data reconciliation by principal component analysis","volume":"41","author":"Tong","year":"1995","journal-title":"AIChE J."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Moss, K.J. (2006). Energy Management Building, Taylor & Francis.","DOI":"10.4324\/9780203349021"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1287\/inte.1040.0092","article-title":"Linking Product Variety to Order-Fulfillment Strategies","volume":"34","author":"Pil","year":"2004","journal-title":"Interfaces"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/7\/2346\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:13:04Z","timestamp":1760195584000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/7\/2346"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,19]]},"references-count":34,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2018,7]]}},"alternative-id":["s18072346"],"URL":"https:\/\/doi.org\/10.3390\/s18072346","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,19]]}}}