Goto

Collaborating Authors

 learningrate 0


SupplementaryMaterialsFor: " DomainAdaptation with InvariantRepresentationLearning: What TransformationstoLearn? "

Neural Information Processing Systems

Furthermore, letฯ†: X Z be an encoder s.t. Then, there is no functionฯ† s.t. Let there be a subset in the invariant spaceB Z, and suppose that we have marginal invariance inthelatent space:PS(ฯ†(X) B) = PT(ฯ†(X) B), B. Define thepre-image ofB as: A={a X:ฯ†(a) B}. Let A X be a region s.t. We followed the procedure in [2], and used a mixture kernel function ofq RBF kernels: ฮบ(z1,z2) = Pq i=1ฮทiexp{ ||z1 z2||2}/ฯƒ2i, where ฯƒ2i is the kernel width of the i-th kernel, and ฮทi is a mixing weight which we set to1/q.



2f2b265625d76a6704b08093c652fd79-Supplemental.pdf

Neural Information Processing Systems

A central challenge in training classification models in the real-world federated system is learning with non-IID data. To cope with this, most of the existing works involve enforcing regularization in local optimization or improving the model aggregation scheme at the server.



114292cf3f930ba157ed33f66997fee2-Supplemental-Conference.pdf

Neural Information Processing Systems

Butwellafterconvergence this flips and policy change is relatively high in these states. In Section 3.3 we already touched on this subject with the experiments onCATCH using value iteration. In this section we revisit the question and try to provide a more definite answer to it. Itiswellknownthatlimk Tkฯ€q =qฯ€ foranyq Q. Equipped with the concepts above, we can now present our example. Clearly,inthe first step, when we change fromฯ€ to ฯ€1 = g(T1ฯ€ qฯ€), the policy changes ins from redto green.


As stated in Section A, we apply the softmax function such thatRAPsoftmax outputs a synthetic datasetdrawnfromsomeprobabilisticfamilyofdistributionsD = n ฯƒ(M)| M Rn

Neural Information Processing Systems

Pt i=1eqi(x)(eai eqi(Di 1)) which is the exactly the distribution computed byMWEM. D(x)log(D(x)) (6) The optimization problem becomesDt = argminD (X)Lmwem(D, eQt, eAt). We show the exact details ofGEM in Algorithms 2 and 3. Note that given a vector of queries Qt = hq1,...,qti,wedefinefQt() = hfq1(),...,fqt()i. B.1 Lossfunction(fork-waymarginals)anddistributionalfamily For anyz R,G(z)outputs a distribution over each attribute, which we can use to calculate the answer toaquery viafq. Empirically,wefindthatour model tends to better capture the distribution of the overall private dataset in this way (Figure 3).


StatEcoNet: Statistical Ecology Neural Networks for Species Distribution Modeling

arXiv.org Machine Learning

This paper focuses on a core task in computational sustainability and statistical ecology: species distribution modeling (SDM). In SDM, the occurrence pattern of a species on a landscape is predicted by environmental features based on observations at a set of locations. At first, SDM may appear to be a binary classification problem, and one might be inclined to employ classic tools (e.g., logistic regression, support vector machines, neural networks) to tackle it. However, wildlife surveys introduce structured noise (especially under-counting) in the species observations. If unaccounted for, these observation errors systematically bias SDMs. To address the unique challenges of SDM, this paper proposes a framework called StatEcoNet. Specifically, this work employs a graphical generative model in statistical ecology to serve as the skeleton of the proposed computational framework and carefully integrates neural networks under the framework. The advantages of StatEcoNet over related approaches are demonstrated on simulated datasets as well as bird species data. Since SDMs are critical tools for ecological science and natural resource management, StatEcoNet may offer boosted computational and analytical powers to a wide range of applications that have significant social impacts, e.g., the study and conservation of threatened species.