Frequently Asked Questions (FAQ)
FAQS: Communication-efficient Federate DNN Architecture and Quantization Co-Search for personalized Hardware-aware Preferences
Chen, Hongjiang, Wang, Yang, Liu, Leibo, Wei, Shaojun, Yin, Shouyi
Due to user privacy and regulatory restrictions, federate learning (FL) is proposed as a distributed learning framework for training deep neural networks (DNN) on decentralized data clients. Recent advancements in FL have applied Neural Architecture Search (NAS) to replace the predefined one-size-fit-all DNN model, which is not optimal for all tasks of various data distributions, with searchable DNN architectures. However, previous methods suffer from expensive communication cost rasied by frequent large model parameters transmission between the server and clients. Such difficulty is further amplified when combining NAS algorithms, which commonly require prohibitive computation and enormous model storage. Towards this end, we propose FAQS, an efficient personalized FL-NAS-Quantization framework to reduce the communication cost with three features: weight-sharing super kernels, bit-sharing quantization and masked transmission. FAQS has an affordable search time and demands very limited size of transmitted messages at each round. By setting different personlized pareto function loss on local clients, FAQS can yield heterogeneous hardware-aware models for various user preferences. Experimental results show that FAQS achieves average reduction of 1.58x in communication bandwith per round compared with normal FL framework and 4.51x compared with FL+NAS framwork.
- Frequently Asked Questions (FAQ) (1.00)
- Research Report > New Finding (0.34)
Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision
Mrini, Khalil, Singh, Harpreet, Dernoncourt, Franck, Yoon, Seunghyun, Bui, Trung, Chang, Walter, Farcas, Emilia, Nakashole, Ndapa
Current medical question answering systems have difficulty processing long, detailed and informally worded questions submitted by patients, called Consumer Health Questions (CHQs). To address this issue, we introduce a medical question understanding and answering system with knowledge grounding and semantic self-supervision. Our system is a pipeline that first summarizes a long, medical, user-written question, using a supervised summarization loss. Then, our system performs a two-step retrieval to return answers. The system first matches the summarized user question with an FAQ from a trusted medical knowledge base, and then retrieves a fixed number of relevant sentences from the corresponding answer document. In the absence of labels for question matching or answer relevance, we design 3 novel, self-supervised and semantically-guided losses. We evaluate our model against two strong retrieval-based question answering baselines. Evaluators ask their own questions and rate the answers retrieved by our baselines and own system according to their relevance. They find that our system retrieves more relevant answers, while achieving speeds 20 times faster. Our self-supervised losses also help the summarizer achieve higher scores in ROUGE, as well as in human evaluation metrics. We release our code to encourage further research.
- North America > United States > New York > New York County > New York City (0.04)
- North America > United States > Hawaii > Honolulu County > Honolulu (0.04)
- North America > United States > California > Santa Clara County > San Jose (0.04)
- (4 more...)
- Research Report (0.50)
- Frequently Asked Questions (FAQ) (0.42)
John Lewis: How AI Can Make FAQs Work Harder for You
Lewis: An ideal experience is something like the help desk at a library. Depending on your question, the librarian may just need to provide a short direct answer or refer you to the reference or periodicals section. Similarly, a search engine needs to align the relevance strategy for each case. For example, for information found in periodicals, the recency of the news or journal publication is important in determining the relevance for the search engine. But the relevance ranking of search results should not penalize a document entered into the system two years ago when looking for factual information that has not changed. For short answers, specific answers should appear that also hyperlink back into the larger documents.
How can I use machine learning for my business? - Rebellion Research
How can I use machine learning for my business? Moreover, the question arrives, so now what? Develop a front-end app with frameworks like Flask or Streamlit and deploy it as a service on the cloud. You must think of data science as a glorified software development problem if you are already not thinking that way. If you can't productionalize your machine learning pipelines – they are of no use.
Matrix AI Network FAQ
An average transaction takes over an hour to verify. If security should be an issue for crypto assets, then there is no point investing in them. PoW of Bitcoin is nothing but meaningless hash computing that creates no real value for society. According to statistics, 70% of the world's computing power is consumed to mine cryptos, which is a million times Google's computing power. Bitcoin mining also consumed more power each year than 260 countries of the world, creating a huge waste.
How can AI/ML improve sensor fusion performance?
Fusion at the data level simply fuses or aggregates multiple sensor data streams, producing a larger quantity of data, assuming that merging similar data sources results in increased precision and better information. Data level fusion is used to reduce noise and improve robustness. Fusion at the feature level uses features derived from several independent sensor nodes or a single node with several sensors. It combines those features into a multi-dimensional vector usable in pattern-recognition algorithms. Machine vision and localization functions are common applications of fusion at the feature level.