MEASURING THE IMPACT OF GENERATIVE AI ON SOFTWARE TEAM PRODUCTIVITY AND OUTPUT QUALITY IN AGILE ENVIRONMENTS
DOI:
https://doi.org/10.65405/j87bwk84Keywords:
Generative artificial intelligence; software engineering; software productivity; software quality; Agile development; team collaboration; empirical survey; software developmentAbstract
Generative artificial intelligence (GAI) is becoming more incorporated into software engineering functions like code creation, debugging, requirement analysis, testing, and sharing knowledge. This research looks at how GAI affects software teams in terms of productivity and quality of the output in Agile environments. The research design used is quantitative, cross-sectional survey type using a questionnaire prepared for this research. The data used consists of 35 responses, with 34 usable cases in analyzing 30 Likert items. The measuring instrument consists of six concepts: use of GAI, efficiency of the software team, quality of the software output, GAI in Agile, team collaboration, and communication, and overall impact perceived. The descriptive results show positive feelings about the six concepts. The values on the mean for the different concepts varied from 3.54 to 3.78 on a scale of five, with GAI being the concept that received the highest mean (M = 3.78, SD = 0.47) while productivity was the one that received the lowest (M = 3.54, SD = 0.69). The instrument has a high level of internal consistency with α = 0.799 for the entire scale of 30 items. In terms of specific items, productivity, quality, and team collaboration had acceptable reliability, whereas GAI had low internal consistency and Agile and general have the upper limit of reliability therefore, construct-level findings should be interpreted cautiously.
Pearson correlation analysis showed statistically significant positive associations between overall perceived impact and software output quality (r = 0.365, p = 0.034) and team collaboration and communication (r = 0.371, p = 0.031). Productivity was positively associated with overall impact but did not reach the conventional 0.05 significance level (r = 0.312, p = 0.073). In a multiple regression model, the five dimensions explained 23.5% of the variance in overall perceived impact (R² = 0.235); however, the overall model was not statistically significant (F(5, 28) = 1.719, p = 0.163). These findings support a cautious interpretation: respondents generally perceive GAI positively, but the present small sample does not provide strong evidence for broad causal claims.
Downloads
References
Cui, K. Z., Demirer, M., Jaffe, S., Musolff, L., Peng, S., & Salz, T. (2026). The effects of generative AI on high-skilled work: Evidence from three field experiments with software developers. Management Science. https://doi.org/10.1287/mnsc.2025.00535
Chang, T.-S., & Huang, L.-G. (2026). The impact of generative artificial intelligence on software development performance: A study based on the theory of technology dominance. Information & Management, 63(3), 104306. https://doi.org/10.1016/j.im.2026.104306
Dybå, T., & Dingsøyr, T. (2008). Empirical studies of agile software development: A systematic review. Information and Software Technology, 50(9–10), 833–859. https://doi.org/10.1016/j.infsof.2008.01.006
Edison, H., Wang, X., & Conboy, K. (2022). Comparing methods for large-scale agile software development: A systematic literature review. IEEE Transactions on Software Engineering, 48(8), 2709–2731. https://doi.org/10.1109/TSE.2021.3069039
Gheventer, A., Gurgel, P. do A., Brito, C. H., Maiani de Mello, R., Rocha, S., Feitosa, R., & Travassos, G. H. (2026). Generative AI solutions for software quality: Assessing industrial readiness. Software Quality Journal, 34, Article 24. https://doi.org/10.1007/s11219-026-09754-7
Barke, S., James, M. B., & Polikarpova, N. (2023). Grounded Copilot: How programmers interact with code-generating models. Proceedings of the ACM on Programming Languages, 7(OOPSLA1), 85–111. https://doi.org/10.1145/3586030
Bird, C., Ford, D., Zimmermann, T., Forsgren, N., Kalliamvakou, E., Lowdermilk, T., & Gazit, I. (2023). Taking flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools. Communications of the ACM, 66(6), 56–62. https://doi.org/10.1145/3589996
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2024). Large language models for software engineering: A systematic literature review. ACM Transactions on Software Engineering and Methodology, 33(8), Article 220. https://doi.org/10.1145/3695988
Imai, S. (2022). Is GitHub Copilot a substitute for human pair-programming? An empirical study. In Proceedings of the IEEE/ACM 44th International Conference on Software Engineering: Companion Proceedings (pp. 319–321). Association for Computing Machinery. https://doi.org/10.1145/3510454.3522684
Kuhail, M. A., Mathew, S. S., Khalil, A., Berengueres, J., & Shah, S. J. H. (2024). “Will I be replaced?” Assessing ChatGPT's effect on software development and programmer perceptions of AI tools. Science of Computer Programming, 235, 103111. https://doi.org/10.1016/j.scico.2024.103111
Liang, J. T., Yang, C., & Myers, B. A. (2024). A large-scale survey on the usability of AI programming assistants: Successes and challenges. In Proceedings of the IEEE/ACM 46th International Conference on Software Engineering (ICSE 2024). Association for Computing Machinery. https://doi.org/10.1145/3597503.3608128
Peng, S., Kalliamvakou, E., Cihon, P., & Demirer, M. (2023). The impact of AI on developer productivity: Evidence from GitHub Copilot. arXiv. https://doi.org/10.48550/arXiv.2302.06590
Sauvola, J., Tarkoma, S., Klemettinen, M., Riekki, J., & Doermann, D. (2024). Future of software development with generative AI. Automated Software Engineering, 31, 26. https://doi.org/10.1007/s10515-024-00426-z
Othman, A. A. (2026). The Role of Artificial Intelligence in Enhancing Programming Skills among University Students: An Empirical Study with Recommendations. مجلة العلوم الشاملة, 11(41), 1182-1188.
Abdulrazigh, M., Awami, A. H. I., Khairalla, M. A. A., & Abdullah, M. E. (2026). The role of artificial intelligence in developing applied engineering education and electrical
engineering skills in Libyan technical colleges. مجلة العلوم الشاملة, 10(39), 1-6.












