Augmenting Training Data for Massive Semantic Matching Models in Low-Traffic E-commerce Stores. Joshi, A., Vishwanath, S., Teo, C., Petricek, V., Vishwanathan, V., Bhagat, R., & May, J. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Track, pages 160–167, Hybrid: Seattle, Washington + Online, July, 2022. Association for Computational Linguistics. Paper abstract bibtex Extreme multi-label classification (XMC) systems have been successfully applied in e-commerce (Shen et al., 2020; Dahiya et al., 2021) for retrieving products based on customer behavior. Such systems require large amounts of customer behavior data (e.g. queries, clicks, purchases) for training. However, behavioral data is limited in low-traffic e-commerce stores, impacting performance of these systems. In this paper, we present a technique that augments behavioral training data via query reformulation. We use the Aggregated Label eXtreme Multi-label Classification (AL-XMC) system (Shen et al., 2020) as an example semantic matching model and show via crowd-sourced human judgments that, when the training data is augmented through query reformulations, the quality of AL-XMC improves over a baseline that does not use query reformulation. We also show in online A/B tests that our method significantly improves business metrics for the AL-XMC model.
@inproceedings{joshi-etal-2022-augmenting,
title = "Augmenting Training Data for Massive Semantic Matching Models in Low-Traffic {E}-commerce Stores",
author = "Joshi, Ashutosh and
Vishwanath, Shankar and
Teo, Choon and
Petricek, Vaclav and
Vishwanathan, Vishy and
Bhagat, Rahul and
May, Jonathan",
booktitle = "Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Track",
month = jul,
year = "2022",
address = "Hybrid: Seattle, Washington + Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.naacl-industry.19",
pages = "160--167",
abstract = "Extreme multi-label classification (XMC) systems have been successfully applied in e-commerce (Shen et al., 2020; Dahiya et al., 2021) for retrieving products based on customer behavior. Such systems require large amounts of customer behavior data (e.g. queries, clicks, purchases) for training. However, behavioral data is limited in low-traffic e-commerce stores, impacting performance of these systems. In this paper, we present a technique that augments behavioral training data via query reformulation. We use the Aggregated Label eXtreme Multi-label Classification (AL-XMC) system (Shen et al., 2020) as an example semantic matching model and show via crowd-sourced human judgments that, when the training data is augmented through query reformulations, the quality of AL-XMC improves over a baseline that does not use query reformulation. We also show in online A/B tests that our method significantly improves business metrics for the AL-XMC model.",
}
Downloads: 0
{"_id":"nGbBQcq6EBJe4tXsf","bibbaseid":"joshi-vishwanath-teo-petricek-vishwanathan-bhagat-may-augmentingtrainingdataformassivesemanticmatchingmodelsinlowtrafficecommercestores-2022","author_short":["Joshi, A.","Vishwanath, S.","Teo, C.","Petricek, V.","Vishwanathan, V.","Bhagat, R.","May, J."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"Augmenting Training Data for Massive Semantic Matching Models in Low-Traffic E-commerce Stores","author":[{"propositions":[],"lastnames":["Joshi"],"firstnames":["Ashutosh"],"suffixes":[]},{"propositions":[],"lastnames":["Vishwanath"],"firstnames":["Shankar"],"suffixes":[]},{"propositions":[],"lastnames":["Teo"],"firstnames":["Choon"],"suffixes":[]},{"propositions":[],"lastnames":["Petricek"],"firstnames":["Vaclav"],"suffixes":[]},{"propositions":[],"lastnames":["Vishwanathan"],"firstnames":["Vishy"],"suffixes":[]},{"propositions":[],"lastnames":["Bhagat"],"firstnames":["Rahul"],"suffixes":[]},{"propositions":[],"lastnames":["May"],"firstnames":["Jonathan"],"suffixes":[]}],"booktitle":"Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Track","month":"July","year":"2022","address":"Hybrid: Seattle, Washington + Online","publisher":"Association for Computational Linguistics","url":"https://aclanthology.org/2022.naacl-industry.19","pages":"160–167","abstract":"Extreme multi-label classification (XMC) systems have been successfully applied in e-commerce (Shen et al., 2020; Dahiya et al., 2021) for retrieving products based on customer behavior. Such systems require large amounts of customer behavior data (e.g. queries, clicks, purchases) for training. However, behavioral data is limited in low-traffic e-commerce stores, impacting performance of these systems. In this paper, we present a technique that augments behavioral training data via query reformulation. We use the Aggregated Label eXtreme Multi-label Classification (AL-XMC) system (Shen et al., 2020) as an example semantic matching model and show via crowd-sourced human judgments that, when the training data is augmented through query reformulations, the quality of AL-XMC improves over a baseline that does not use query reformulation. We also show in online A/B tests that our method significantly improves business metrics for the AL-XMC model.","bibtex":"@inproceedings{joshi-etal-2022-augmenting,\n title = \"Augmenting Training Data for Massive Semantic Matching Models in Low-Traffic {E}-commerce Stores\",\n author = \"Joshi, Ashutosh and\n Vishwanath, Shankar and\n Teo, Choon and\n Petricek, Vaclav and\n Vishwanathan, Vishy and\n Bhagat, Rahul and\n May, Jonathan\",\n booktitle = \"Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Industry Track\",\n month = jul,\n year = \"2022\",\n address = \"Hybrid: Seattle, Washington + Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2022.naacl-industry.19\",\n pages = \"160--167\",\n abstract = \"Extreme multi-label classification (XMC) systems have been successfully applied in e-commerce (Shen et al., 2020; Dahiya et al., 2021) for retrieving products based on customer behavior. Such systems require large amounts of customer behavior data (e.g. queries, clicks, purchases) for training. However, behavioral data is limited in low-traffic e-commerce stores, impacting performance of these systems. In this paper, we present a technique that augments behavioral training data via query reformulation. We use the Aggregated Label eXtreme Multi-label Classification (AL-XMC) system (Shen et al., 2020) as an example semantic matching model and show via crowd-sourced human judgments that, when the training data is augmented through query reformulations, the quality of AL-XMC improves over a baseline that does not use query reformulation. We also show in online A/B tests that our method significantly improves business metrics for the AL-XMC model.\",\n}\n\n\n","author_short":["Joshi, A.","Vishwanath, S.","Teo, C.","Petricek, V.","Vishwanathan, V.","Bhagat, R.","May, J."],"key":"joshi-etal-2022-augmenting","id":"joshi-etal-2022-augmenting","bibbaseid":"joshi-vishwanath-teo-petricek-vishwanathan-bhagat-may-augmentingtrainingdataformassivesemanticmatchingmodelsinlowtrafficecommercestores-2022","role":"author","urls":{"Paper":"https://aclanthology.org/2022.naacl-industry.19"},"metadata":{"authorlinks":{}}},"bibtype":"inproceedings","biburl":"https://jonmay.github.io/webpage/cutelabname/cutelabname.bib","dataSources":["hbZSwot2msWk92m5B","j3Qzx9HAAC6WtJDHS","5eM3sAccSEpjSDHHQ"],"keywords":[],"search_terms":["augmenting","training","data","massive","semantic","matching","models","low","traffic","commerce","stores","joshi","vishwanath","teo","petricek","vishwanathan","bhagat","may"],"title":"Augmenting Training Data for Massive Semantic Matching Models in Low-Traffic E-commerce Stores","year":2022}