cs updates on arXiv.org

Raw Audio for Depression Detection Can Be More Robust Against Gender Imbalance than Mel-Spectrogram Features. (arXiv:2010.15120v1 [cs.SD])

Depression is a large-scale mental health problem and a challenging area for Err codemadness.org 70 i 476 machine learning researchers in terms of the detection of depression. Datasets Err codemadness.org 70 i 477 such as the Distress Analysis Interview Corpus - Wizard of Oz have been created Err codemadness.org 70 i 478 to aid research in this area. However, on top of the challenges inherent in Err codemadness.org 70 i 479 accurately detecting depression, biases in datasets may result in skewed Err codemadness.org 70 i 480 classification performance. In this paper we examine gender bias in the Err codemadness.org 70 i 481 DAIC-WOZ dataset using audio-based deep neural networks. We show that gender Err codemadness.org 70 i 482 biases in DAIC-WOZ can lead to an overreporting of performance, which has been Err codemadness.org 70 i 483 overlooked in the past due to the same gender biases being present in the test Err codemadness.org 70 i 484 set. By using raw audio and different concepts from Fair Machine Learning, such Err codemadness.org 70 i 485 as data re-distribution, we can mitigate against the harmful effects of bias. Err codemadness.org 70 i 486

Err codemadness.org 70 i 487

papaya2: 2D Irreducible Minkowski Tensor computation. (arXiv:2010.15138v1 [cs.GR])

A common challenge in scientific and technical domains is the quantitative Err codemadness.org 70 i 494 description of geometries and shapes, e.g. in the analysis of microscope Err codemadness.org 70 i 495 imagery or astronomical observation data. Frequently, it is desirable to go Err codemadness.org 70 i 496 beyond scalar shape metrics such as porosity and surface to volume ratios Err codemadness.org 70 i 497 because the samples are anisotropic or because direction-dependent quantities Err codemadness.org 70 i 498 such as conductances or elasticity are of interest. Minkowski Tensors are a Err codemadness.org 70 i 499 systematic family of versatile and robust higher-order shape descriptors that Err codemadness.org 70 i 500 allow for shape characterization of arbitrary order and promise a path to Err codemadness.org 70 i 501 systematic structure-function relationships for direction-dependent properties. Err codemadness.org 70 i 502 Papaya2 is a software to calculate 2D higher-order shape metrics with a library Err codemadness.org 70 i 503 interface, support for Irreducible Minkowski Tensors and interpolated marching Err codemadness.org 70 i 504 squares. Extensions to Matlab, JavaScript and Python are provided as well. Err codemadness.org 70 i 505 While the tensor of inertia is computed by many tools, we are not aware of Err codemadness.org 70 i 506 other open-source software which provides higher-rank shape characterization in Err codemadness.org 70 i 507 2D. Err codemadness.org 70 i 508

Err codemadness.org 70 i 509

DeSMOG: Detecting Stance in Media On Global Warming. (arXiv:2010.15149v1 [cs.CL])

Citing opinions is a powerful yet understudied strategy in argumentation. For Err codemadness.org 70 i 516 example, an environmental activist might say, "Leading scientists agree that Err codemadness.org 70 i 517 global warming is a serious concern," framing a clause which affirms their own Err codemadness.org 70 i 518 stance ("that global warming is serious") as an opinion endorsed ("[scientists] Err codemadness.org 70 i 519 agree") by a reputable source ("leading"). In contrast, a global warming denier Err codemadness.org 70 i 520 might frame the same clause as the opinion of an untrustworthy source with a Err codemadness.org 70 i 521 predicate connoting doubt: "Mistaken scientists claim [...]." Our work studies Err codemadness.org 70 i 522 opinion-framing in the global warming (GW) debate, an increasingly partisan Err codemadness.org 70 i 523 issue that has received little attention in NLP. We introduce DeSMOG, a dataset Err codemadness.org 70 i 524 of stance-labeled GW sentences, and train a BERT classifier to study novel Err codemadness.org 70 i 525 aspects of argumentation in how different sides of a debate represent their own Err codemadness.org 70 i 526 and each other's opinions. From 56K news articles, we find that similar Err codemadness.org 70 i 527 linguistic devices for self-affirming and opponent-doubting discourse are used Err codemadness.org 70 i 528 across GW-accepting and skeptic media, though GW-skeptical media shows more Err codemadness.org 70 i 529 opponent-doubt. We also find that authors often characterize sources as Err codemadness.org 70 i 530 hypocritical, by ascribing opinions expressing the author's own view to source Err codemadness.org 70 i 531 entities known to publicly endorse the opposing view. We release our stance Err codemadness.org 70 i 532 dataset, model, and lexicons of framing devices for future work on Err codemadness.org 70 i 533 opinion-framing and the automatic detection of GW stance. Err codemadness.org 70 i 534

Err codemadness.org 70 i 535

On the Optimality and Convergence Properties of the Learning Model Predictive Controller. (arXiv:2010.15153v1 [math.OC])

In this technical note we analyse the performance improvement and optimality Err codemadness.org 70 i 542 properties of the Learning Model Predictive Control (LMPC) strategy for linear Err codemadness.org 70 i 543 deterministic systems. The LMPC framework is a policy iteration scheme where Err codemadness.org 70 i 544 closed-loop trajectories are used to update the control policy for the next Err codemadness.org 70 i 545 execution of the control task. We show that, when a Linear Independence Err codemadness.org 70 i 546 Constraint Qualification (LICQ) condition holds, the LMPC scheme guarantees Err codemadness.org 70 i 547 strict iterative performance improvement and optimality, meaning that the Err codemadness.org 70 i 548 closed-loop cost evaluated over the entire task converges asymptotically to the Err codemadness.org 70 i 549 optimal cost of the infinite-horizon control problem. Compared to previous Err codemadness.org 70 i 550 works this sufficient LICQ condition can be easily checked, it holds for a Err codemadness.org 70 i 551 larger class of systems and it can be used to adaptively select the prediction Err codemadness.org 70 i 552 horizon of the controller, as demonstrated by a numerical example. Err codemadness.org 70 i 553

Err codemadness.org 70 i 554

Kernel Aggregated Fast Multipole Method: Efficient summation of Laplace and Stokes kernel functions. (arXiv:2010.15155v1 [math.NA])

Many different simulation methods for Stokes flow problems involve a common Err codemadness.org 70 i 561 computationally intense task---the summation of a kernel function over $O(N^2)$ Err codemadness.org 70 i 562 pairs of points. One popular technique is the Kernel Independent Fast Multipole Err codemadness.org 70 i 563 Method (KIFMM), which constructs a spatial adaptive octree and places a small Err codemadness.org 70 i 564 number of equivalent multipole and local points around each octree box, and Err codemadness.org 70 i 565 completes the kernel sum with $O(N)$ performance. However, the KIFMM cannot be Err codemadness.org 70 i 566 used directly with nonlinear kernels, can be inefficient for complicated linear Err codemadness.org 70 i 567 kernels, and in general is difficult to implement compared to less-efficient Err codemadness.org 70 i 568 alternatives such as Ewald-type methods. Here we present the Kernel Aggregated Err codemadness.org 70 i 569 Fast Multipole Method (KAFMM), which overcomes these drawbacks by allowing Err codemadness.org 70 i 570 different kernel functions to be used for specific stages of octree traversal. Err codemadness.org 70 i 571 In many cases a simpler linear kernel suffices during the most extensive stage Err codemadness.org 70 i 572 of octree traversal, even for nonlinear kernel summation problems. The KAFMM Err codemadness.org 70 i 573 thereby improves computational efficiency in general and also allows efficient Err codemadness.org 70 i 574 evaluation of some nonlinear kernel functions such as the regularized Err codemadness.org 70 i 575 Stokeslet. We have implemented our method as an open-source software library Err codemadness.org 70 i 576 STKFMM with support for Laplace kernels, the Stokeslet, regularized Stokeslet, Err codemadness.org 70 i 577 Rotne-Prager-Yamakawa (RPY) tensor, and the Stokes double-layer and traction Err codemadness.org 70 i 578 operators. Open and periodic boundary conditions are supported for all kernels, Err codemadness.org 70 i 579 and the no-slip wall boundary condition is supported for the Stokeslet and RPY Err codemadness.org 70 i 580 tensor. The package is designed to be ready-to-use as well as being readily Err codemadness.org 70 i 581 extensible to additional kernels. Massive parallelism is supported with mixed Err codemadness.org 70 i 582 OpenMP and MPI. Err codemadness.org 70 i 583

Err codemadness.org 70 i 584

Diagnostic data integration using deep neural networks for real-time plasma analysis. (arXiv:2010.15156v1 [physics.comp-ph])

Recent advances in acquisition equipment is providing experiments with Err codemadness.org 70 i 591 growing amounts of precise yet affordable sensors. At the same time an improved Err codemadness.org 70 i 592 computational power, coming from new hardware resources (GPU, FPGA, ACAP), has Err codemadness.org 70 i 593 been made available at relatively low costs. This led us to explore the Err codemadness.org 70 i 594 possibility of completely renewing the chain of acquisition for a fusion Err codemadness.org 70 i 595 experiment, where many high-rate sources of data, coming from different Err codemadness.org 70 i 596 diagnostics, can be combined in a wide framework of algorithms. If on one hand Err codemadness.org 70 i 597 adding new data sources with different diagnostics enriches our knowledge about Err codemadness.org 70 i 598 physical aspects, on the other hand the dimensions of the overall model grow, Err codemadness.org 70 i 599 making relations among variables more and more opaque. A new approach for the Err codemadness.org 70 i 600 integration of such heterogeneous diagnostics, based on composition of deep Err codemadness.org 70 i 601 \textit{variational autoencoders}, could ease this problem, acting as a Err codemadness.org 70 i 602 structural sparse regularizer. This has been applied to RFX-mod experiment Err codemadness.org 70 i 603 data, integrating the soft X-ray linear images of plasma temperature with the Err codemadness.org 70 i 604 magnetic state. Err codemadness.org 70 i 605

Err codemadness.org 70 i 606

However to ensure a real-time signal analysis, those algorithmic techniques Err codemadness.org 70 i 607 must be adapted to run in well suited hardware. In particular it is shown that, Err codemadness.org 70 i 608 attempting a quantization of neurons transfer functions, such models can be Err codemadness.org 70 i 609 modified to create an embedded firmware. This firmware, approximating the deep Err codemadness.org 70 i 610 inference model to a set of simple operations, fits well with the simple logic Err codemadness.org 70 i 611 units that are largely abundant in FPGAs. This is the key factor that permits Err codemadness.org 70 i 612 the use of affordable hardware with complex deep neural topology and operates Err codemadness.org 70 i 613 them in real-time. Err codemadness.org 70 i 614

Err codemadness.org 70 i 615

Panoster: End-to-end Panoptic Segmentation of LiDAR Point Clouds. (arXiv:2010.15157v1 [cs.CV])

Panoptic segmentation has recently unified semantic and instance Err codemadness.org 70 i 622 segmentation, previously addressed separately, thus taking a step further Err codemadness.org 70 i 623 towards creating more comprehensive and efficient perception systems. In this Err codemadness.org 70 i 624 paper, we present Panoster, a novel proposal-free panoptic segmentation method Err codemadness.org 70 i 625 for point clouds. Unlike previous approaches relying on several steps to group Err codemadness.org 70 i 626 pixels or points into objects, Panoster proposes a simplified framework Err codemadness.org 70 i 627 incorporating a learning-based clustering solution to identify instances. At Err codemadness.org 70 i 628 inference time, this acts as a class-agnostic semantic segmentation, allowing Err codemadness.org 70 i 629 Panoster to be fast, while outperforming prior methods in terms of accuracy. Err codemadness.org 70 i 630 Additionally, we showcase how our approach can be flexibly and effectively Err codemadness.org 70 i 631 applied on diverse existing semantic architectures to deliver panoptic Err codemadness.org 70 i 632 predictions. Err codemadness.org 70 i 633

Err codemadness.org 70 i 634

CNN Profiler on Polar Coordinate Images for Tropical Cyclone Structure Analysis. (arXiv:2010.15158v1 [cs.CV])

Convolutional neural networks (CNN) have achieved great success in analyzing Err codemadness.org 70 i 641 tropical cyclones (TC) with satellite images in several tasks, such as TC Err codemadness.org 70 i 642 intensity estimation. In contrast, TC structure, which is conventionally Err codemadness.org 70 i 643 described by a few parameters estimated subjectively by meteorology Err codemadness.org 70 i 644 specialists, is still hard to be profiled objectively and routinely. This study Err codemadness.org 70 i 645 applies CNN on satellite images to create the entire TC structure profiles, Err codemadness.org 70 i 646 covering all the structural parameters. By utilizing the meteorological domain Err codemadness.org 70 i 647 knowledge to construct TC wind profiles based on historical structure Err codemadness.org 70 i 648 parameters, we provide valuable labels for training in our newly released Err codemadness.org 70 i 649 benchmark dataset. With such a dataset, we hope to attract more attention to Err codemadness.org 70 i 650 this crucial issue among data scientists. Meanwhile, a baseline is established Err codemadness.org 70 i 651 with a specialized convolutional model operating on polar-coordinates. We Err codemadness.org 70 i 652 discovered that it is more feasible and physically reasonable to extract Err codemadness.org 70 i 653 structural information on polar-coordinates, instead of Cartesian coordinates, Err codemadness.org 70 i 654 according to a TC's rotational and spiral natures. Experimental results on the Err codemadness.org 70 i 655 released benchmark dataset verified the robustness of the proposed model and Err codemadness.org 70 i 656 demonstrated the potential for applying deep learning techniques for this Err codemadness.org 70 i 657 barely developed yet important topic. Err codemadness.org 70 i 658

Err codemadness.org 70 i 659

Sizeless: Predicting the optimal size of serverless functions. (arXiv:2010.15162v1 [cs.DC])

Serverless functions are a cloud computing paradigm that reduces operational Err codemadness.org 70 i 666 overheads for developers, because the cloud provider takes care of resource Err codemadness.org 70 i 667 management tasks such as resource provisioning, deployment, and auto-scaling. Err codemadness.org 70 i 668 The only resource management task that developers are still in charge of is Err codemadness.org 70 i 669 resource sizing, that is, selecting how much resources are allocated to each Err codemadness.org 70 i 670 worker instance. However, due to the challenging nature of resource sizing, Err codemadness.org 70 i 671 developers often neglect it despite its significant cost and performance Err codemadness.org 70 i 672 benefits. Existing approaches aiming to automate serverless functions resource Err codemadness.org 70 i 673 sizing require dedicated performance tests, which are time consuming to Err codemadness.org 70 i 674 implement and maintain. Err codemadness.org 70 i 675

Err codemadness.org 70 i 676

In this paper, we introduce Sizeless -- an approach to predict the optimal Err codemadness.org 70 i 677 resource size of a serverless function using monitoring data from a single Err codemadness.org 70 i 678 resource size. As our approach requires only production monitoring data, Err codemadness.org 70 i 679 developers no longer need to implement and maintain representative performance Err codemadness.org 70 i 680 tests. Furthermore, it enables cloud providers, which cannot engage in testing Err codemadness.org 70 i 681 the performance of user functions, to implement resource sizing on a platform Err codemadness.org 70 i 682 level and automate the last resource management task associated with serverless Err codemadness.org 70 i 683 functions. In our evaluation, Sizeless was able to predict the execution time Err codemadness.org 70 i 684 of the serverless functions of a realistic server-less application with a Err codemadness.org 70 i 685 median prediction accuracy of 93.1%. Using Sizeless to optimize the memory size Err codemadness.org 70 i 686 of this application results in a speedup of 16.7% while simultaneously Err codemadness.org 70 i 687 decreasing costs by 2.5%. Err codemadness.org 70 i 688

Err codemadness.org 70 i 689

Polymer Informatics with Multi-Task Learning. (arXiv:2010.15166v1 [cond-mat.mtrl-sci])

Modern data-driven tools are transforming application-specific polymer Err codemadness.org 70 i 696 development cycles. Surrogate models that can be trained to predict the Err codemadness.org 70 i 697 properties of new polymers are becoming commonplace. Nevertheless, these models Err codemadness.org 70 i 698 do not utilize the full breadth of the knowledge available in datasets, which Err codemadness.org 70 i 699 are oftentimes sparse; inherent correlations between different property Err codemadness.org 70 i 700 datasets are disregarded. Here, we demonstrate the potency of multi-task Err codemadness.org 70 i 701 learning approaches that exploit such inherent correlations effectively, Err codemadness.org 70 i 702 particularly when some property dataset sizes are small. Data pertaining to 36 Err codemadness.org 70 i 703 different properties of over $13, 000$ polymers (corresponding to over $23,000$ Err codemadness.org 70 i 704 data points) are coalesced and supplied to deep-learning multi-task Err codemadness.org 70 i 705 architectures. Compared to conventional single-task learning models (that are Err codemadness.org 70 i 706 trained on individual property datasets independently), the multi-task approach Err codemadness.org 70 i 707 is accurate, efficient, scalable, and amenable to transfer learning as more Err codemadness.org 70 i 708 data on the same or different properties become available. Moreover, these Err codemadness.org 70 i 709 models are interpretable. Chemical rules, that explain how certain features Err codemadness.org 70 i 710 control trends in specific property values, emerge from the present work, Err codemadness.org 70 i 711 paving the way for the rational design of application specific polymers meeting Err codemadness.org 70 i 712 desired property or performance objectives. Err codemadness.org 70 i 713

Err codemadness.org 70 i 714

Semi-Grant-Free NOMA: Ergodic Rates Analysis with Random Deployed Users. (arXiv:2010.15169v1 [cs.IT])

Semi-grant-free (Semi-GF) non-orthogonal multiple access (NOMA) enables Err codemadness.org 70 i 721 grant-free (GF) and grant-based (GB) users to share the same resource blocks, Err codemadness.org 70 i 722 thereby balancing the connectivity and stability of communications. This letter Err codemadness.org 70 i 723 analyzes ergodic rates of Semi-GF NOMA systems. First, this paper exploits a Err codemadness.org 70 i 724 Semi-GF protocol, denoted as dynamic protocol, for selecting GF users into the Err codemadness.org 70 i 725 occupied GB channels via the GB user's instantaneous received power. Under this Err codemadness.org 70 i 726 protocol, the closed-form analytical and approximated expressions for ergodic Err codemadness.org 70 i 727 rates are derived. The numerical results illustrate that the GF user (weak NOMA Err codemadness.org 70 i 728 user) has a performance upper limit, while the ergodic rate of the GB user Err codemadness.org 70 i 729 (strong NOMA user) increases linearly versus the transmit signal-to-noise Err codemadness.org 70 i 730 ratio. Err codemadness.org 70 i 731

Err codemadness.org 70 i 732

Slicing a single wireless collision channel among throughput- and timeliness-sensitive services. (arXiv:2010.15171v1 [cs.IT])

The fifth generation (5G) wireless system has a platform-driven approach, Err codemadness.org 70 i 739 aiming to support heterogeneous connections with very diverse requirements. The Err codemadness.org 70 i 740 shared wireless resources should be sliced in a way that each user perceives Err codemadness.org 70 i 741 that its requirement has been met. Heterogeneity challenges the traditional Err codemadness.org 70 i 742 notion of resource efficiency, as the resource usage has cater for, e.g. rate Err codemadness.org 70 i 743 maximization for one user and timeliness requirement for another user. This Err codemadness.org 70 i 744 paper treats a model for radio access network (RAN) uplink, where a Err codemadness.org 70 i 745 throughput-demanding broadband user shares wireless resources with an Err codemadness.org 70 i 746 intermittently active user that wants to optimize the timeliness, expressed in Err codemadness.org 70 i 747 terms of latency-reliability or Age of Information (AoI). We evaluate the Err codemadness.org 70 i 748 trade-offs between throughput and timeliness for Orthogonal Multiple Access Err codemadness.org 70 i 749 (OMA) as well as Non-Orthogonal Multiple Access (NOMA) with successive Err codemadness.org 70 i 750 interference cancellation (SIC). We observe that NOMA with SIC, in a Err codemadness.org 70 i 751 conservative scenario with destructive collisions, is just slightly inferior to Err codemadness.org 70 i 752 that of OMA, which indicates that it may offer significant benefits in Err codemadness.org 70 i 753 practical deployments where the capture effect is frequently encountered. On Err codemadness.org 70 i 754 the other hand, finding the optimal configuration of NOMA with SIC depends on Err codemadness.org 70 i 755 the activity pattern of the intermittent user, to which OMA is insensitive. Err codemadness.org 70 i 756

Err codemadness.org 70 i 757

Improving Perceptual Quality by Phone-Fortified Perceptual Loss for Speech Enhancement. (arXiv:2010.15174v1 [cs.SD])

Speech enhancement (SE) aims to improve speech quality and intelligibility, Err codemadness.org 70 i 764 which are both related to a smooth transition in speech segments that may carry Err codemadness.org 70 i 765 linguistic information, e.g. phones and syllables. In this study, we took Err codemadness.org 70 i 766 phonetic characteristics into account in the SE training process. Hence, we Err codemadness.org 70 i 767 designed a phone-fortified perceptual (PFP) loss, and the training of our SE Err codemadness.org 70 i 768 model was guided by PFP loss. In PFP loss, phonetic characteristics are Err codemadness.org 70 i 769 extracted by wav2vec, an unsupervised learning model based on the contrastive Err codemadness.org 70 i 770 predictive coding (CPC) criterion. Different from previous deep-feature-based Err codemadness.org 70 i 771 approaches, the proposed approach explicitly uses the phonetic information in Err codemadness.org 70 i 772 the deep feature extraction process to guide the SE model training. To test the Err codemadness.org 70 i 773 proposed approach, we first confirmed that the wav2vec representations carried Err codemadness.org 70 i 774 clear phonetic information using a t-distributed stochastic neighbor embedding Err codemadness.org 70 i 775 (t-SNE) analysis. Next, we observed that the proposed PFP loss was more Err codemadness.org 70 i 776 strongly correlated with the perceptual evaluation metrics than point-wise and Err codemadness.org 70 i 777 signal-level losses, thus achieving higher scores for standardized quality and Err codemadness.org 70 i 778 intelligibility evaluation metrics in the Voice Bank--DEMAND dataset. Err codemadness.org 70 i 779

Err codemadness.org 70 i 780

A Study on Efficiency in Continual Learning Inspired by Human Learning. (arXiv:2010.15187v1 [cs.LG])

Humans are efficient continual learning systems; we continually learn new Err codemadness.org 70 i 787 skills from birth with finite cells and resources. Our learning is highly Err codemadness.org 70 i 788 optimized both in terms of capacity and time while not suffering from Err codemadness.org 70 i 789 catastrophic forgetting. In this work we study the efficiency of continual Err codemadness.org 70 i 790 learning systems, taking inspiration from human learning. In particular, Err codemadness.org 70 i 791 inspired by the mechanisms of sleep, we evaluate popular pruning-based Err codemadness.org 70 i 792 continual learning algorithms, using PackNet as a case study. First, we Err codemadness.org 70 i 793 identify that weight freezing, which is used in continual learning without Err codemadness.org 70 i 794 biological justification, can result in over $2\times$ as many weights being Err codemadness.org 70 i 795 used for a given level of performance. Secondly, we note the similarity in Err codemadness.org 70 i 796 human day and night time behaviors to the training and pruning phases Err codemadness.org 70 i 797 respectively of PackNet. We study a setting where the pruning phase is given a Err codemadness.org 70 i 798 time budget, and identify connections between iterative pruning and multiple Err codemadness.org 70 i 799 sleep cycles in humans. We show there exists an optimal choice of iteration Err codemadness.org 70 i 800 v.s. epochs given different tasks. Err codemadness.org 70 i 801

Err codemadness.org 70 i 802

Explicit stabilized multirate method for stiff stochastic differential equations. (arXiv:2010.15193v1 [math.NA])

Stabilized explicit methods are particularly efficient for large systems of Err codemadness.org 70 i 809 stiff stochastic differential equations (SDEs) due to their extended stability Err codemadness.org 70 i 810 domain. However, they loose their efficiency when a severe stiffness is induced Err codemadness.org 70 i 811 by very few "fast" degrees of freedom, as the stiff and nonstiff terms are Err codemadness.org 70 i 812 evaluated concurrently. Therefore, inspired by [A. Abdulle, M. J. Grote, and G. Err codemadness.org 70 i 813 Rosilho de Souza, Preprint (2020), arXiv:2006.00744] we introduce a stochastic Err codemadness.org 70 i 814 modified equation whose stiffness depends solely on the "slow" terms. By Err codemadness.org 70 i 815 integrating this modified equation with a stabilized explicit scheme we devise Err codemadness.org 70 i 816 a multirate method which overcomes the bottleneck caused by a few severely Err codemadness.org 70 i 817 stiff terms and recovers the efficiency of stabilized schemes for large systems Err codemadness.org 70 i 818 of nonlinear SDEs. The scheme is not based on any scale separation assumption Err codemadness.org 70 i 819 of the SDE and therefore it is employable for problems stemming from the Err codemadness.org 70 i 820 spatial discretization of stochastic parabolic partial differential equations Err codemadness.org 70 i 821 on locally refined grids. The multirate scheme has strong order 1/2, weak order Err codemadness.org 70 i 822 1 and its stability is proved on a model problem. Numerical experiments confirm Err codemadness.org 70 i 823 the efficiency and accuracy of the scheme. Err codemadness.org 70 i 824

Err codemadness.org 70 i 825

Reinforcement Learning for Sparse-Reward Object-Interaction Tasks in First-person Simulated 3D Environments. (arXiv:2010.15195v1 [cs.LG])

First-person object-interaction tasks in high-fidelity, 3D, simulated Err codemadness.org 70 i 832 environments such as the AI2Thor virtual home-environment pose significant Err codemadness.org 70 i 833 sample-efficiency challenges for reinforcement learning (RL) agents learning Err codemadness.org 70 i 834 from sparse task rewards. To alleviate these challenges, prior work has Err codemadness.org 70 i 835 provided extensive supervision via a combination of reward-shaping, Err codemadness.org 70 i 836 ground-truth object-information, and expert demonstrations. In this work, we Err codemadness.org 70 i 837 show that one can learn object-interaction tasks from scratch without Err codemadness.org 70 i 838 supervision by learning an attentive object-model as an auxiliary task during Err codemadness.org 70 i 839 task learning with an object-centric relational RL agent. Our key insight is Err codemadness.org 70 i 840 that learning an object-model that incorporates object-attention into forward Err codemadness.org 70 i 841 prediction provides a dense learning signal for unsupervised representation Err codemadness.org 70 i 842 learning of both objects and their relationships. This, in turn, enables faster Err codemadness.org 70 i 843 policy learning for an object-centric relational RL agent. We demonstrate our Err codemadness.org 70 i 844 agent by introducing a set of challenging object-interaction tasks in the Err codemadness.org 70 i 845 AI2Thor environment where learning with our attentive object-model is key to Err codemadness.org 70 i 846 strong performance. Specifically, we compare our agent and relational RL agents Err codemadness.org 70 i 847 with alternative auxiliary tasks to a relational RL agent equipped with Err codemadness.org 70 i 848 ground-truth object-information, and show that learning with our object-model Err codemadness.org 70 i 849 best closes the performance gap in terms of both learning speed and maximum Err codemadness.org 70 i 850 success rate. Additionally, we find that incorporating object-attention into an Err codemadness.org 70 i 851 object-model's forward predictions is key to learning representations which Err codemadness.org 70 i 852 capture object-category and object-state. Err codemadness.org 70 i 853

Err codemadness.org 70 i 854

A fast and scalable computational framework for large-scale and high-dimensional Bayesian optimal experimental design. (arXiv:2010.15196v1 [math.NA])

We develop a fast and scalable computational framework to solve large-scale Err codemadness.org 70 i 861 and high-dimensional Bayesian optimal experimental design problems. In Err codemadness.org 70 i 862 particular, we consider the problem of optimal observation sensor placement for Err codemadness.org 70 i 863 Bayesian inference of high-dimensional parameters governed by partial Err codemadness.org 70 i 864 differential equations (PDEs), which is formulated as an optimization problem Err codemadness.org 70 i 865 that seeks to maximize an expected information gain (EIG). Such optimization Err codemadness.org 70 i 866 problems are particularly challenging due to the curse of dimensionality for Err codemadness.org 70 i 867 high-dimensional parameters and the expensive solution of large-scale PDEs. To Err codemadness.org 70 i 868 address these challenges, we exploit two essential properties of such problems: Err codemadness.org 70 i 869 the low-rank structure of the Jacobian of the parameter-to-observable map to Err codemadness.org 70 i 870 extract the intrinsically low-dimensional data-informed subspace, and the high Err codemadness.org 70 i 871 correlation of the approximate EIGs by a series of approximations to reduce the Err codemadness.org 70 i 872 number of PDE solves. We propose an efficient offline-online decomposition for Err codemadness.org 70 i 873 the optimization problem: an offline stage of computing all the quantities that Err codemadness.org 70 i 874 require a limited number of PDE solves independent of parameter and data Err codemadness.org 70 i 875 dimensions, and an online stage of optimizing sensor placement that does not Err codemadness.org 70 i 876 require any PDE solve. For the online optimization, we propose a swapping Err codemadness.org 70 i 877 greedy algorithm that first construct an initial set of sensors using leverage Err codemadness.org 70 i 878 scores and then swap the chosen sensors with other candidates until certain Err codemadness.org 70 i 879 convergence criteria are met. We demonstrate the efficiency and scalability of Err codemadness.org 70 i 880 the proposed computational framework by a linear inverse problem of inferring Err codemadness.org 70 i 881 the initial condition for an advection-diffusion equation, and a nonlinear Err codemadness.org 70 i 882 inverse problem of inferring the diffusion coefficient of a log-normal Err codemadness.org 70 i 883 diffusion equation, with both the parameter and data dimensions ranging from a Err codemadness.org 70 i 884 few tens to a few thousands. Err codemadness.org 70 i 885

Err codemadness.org 70 i 886

Forecasting Hamiltonian dynamics without canonical coordinates. (arXiv:2010.15201v1 [cs.LG])

Conventional neural networks are universal function approximators, but Err codemadness.org 70 i 893 because they are unaware of underlying symmetries or physical laws, they may Err codemadness.org 70 i 894 need impractically many training data to approximate nonlinear dynamics. Err codemadness.org 70 i 895 Recently introduced Hamiltonian neural networks can efficiently learn and Err codemadness.org 70 i 896 forecast dynamical systems that conserve energy, but they require special Err codemadness.org 70 i 897 inputs called canonical coordinates, which may be hard to infer from data. Here Err codemadness.org 70 i 898 we significantly expand the scope of such networks by demonstrating a simple Err codemadness.org 70 i 899 way to train them with any set of generalised coordinates, including easily Err codemadness.org 70 i 900 observable ones. Err codemadness.org 70 i 901

Err codemadness.org 70 i 902

Micromobility in Smart Cities: A Closer Look at Shared Dockless E-Scooters via Big Social Data. (arXiv:2010.15203v1 [cs.SI])

The micromobility is shaping first- and last-mile travels in urban areas. Err codemadness.org 70 i 909 Recently, shared dockless electric scooters (e-scooters) have emerged as a Err codemadness.org 70 i 910 daily alternative to driving for short-distance commuters in large cities due Err codemadness.org 70 i 911 to the affordability, easy accessibility via an app, and zero emissions. Err codemadness.org 70 i 912 Meanwhile, e-scooters come with challenges in city management, such as traffic Err codemadness.org 70 i 913 rules, public safety, parking regulations, and liability issues. In this paper, Err codemadness.org 70 i 914 we collected and investigated 5.8 million scooter-tagged tweets and 144,197 Err codemadness.org 70 i 915 images, generated by 2.7 million users from October 2018 to March 2020, to take Err codemadness.org 70 i 916 a closer look at shared e-scooters via crowdsourcing data analytics. We Err codemadness.org 70 i 917 profiled e-scooter usages from spatial-temporal perspectives, explored Err codemadness.org 70 i 918 different business roles (i.e., riders, gig workers, and ridesharing Err codemadness.org 70 i 919 companies), examined operation patterns (e.g., injury types, and parking Err codemadness.org 70 i 920 behaviors), and conducted sentiment analysis. To our best knowledge, this paper Err codemadness.org 70 i 921 is the first large-scale systematic study on shared e-scooters using big social Err codemadness.org 70 i 922 data. Err codemadness.org 70 i 923

Err codemadness.org 70 i 924

Rosella: A Self-Driving Distributed Scheduler for Heterogeneous Clusters. (arXiv:2010.15206v1 [cs.DC])

Large-scale interactive web services and advanced AI applications make Err codemadness.org 70 i 931 sophisticated decisions in real-time, based on executing a massive amount of Err codemadness.org 70 i 932 computation tasks on thousands of servers. Task schedulers, which often operate Err codemadness.org 70 i 933 in heterogeneous and volatile environments, require high throughput, i.e., Err codemadness.org 70 i 934 scheduling millions of tasks per second, and low latency, i.e., incurring Err codemadness.org 70 i 935 minimal scheduling delays for millisecond-level tasks. Scheduling is further Err codemadness.org 70 i 936 complicated by other users' workloads in a shared system, other background Err codemadness.org 70 i 937 activities, and the diverse hardware configurations inside datacenters. Err codemadness.org 70 i 938

Err codemadness.org 70 i 939

We present Rosella, a new self-driving, distributed approach for task Err codemadness.org 70 i 940 scheduling in heterogeneous clusters. Our system automatically learns the Err codemadness.org 70 i 941 compute environment and adjust its scheduling policy in real-time. The solution Err codemadness.org 70 i 942 provides high throughput and low latency simultaneously, because it runs in Err codemadness.org 70 i 943 parallel on multiple machines with minimum coordination and only performs Err codemadness.org 70 i 944 simple operations for each scheduling decision. Our learning module monitors Err codemadness.org 70 i 945 total system load, and uses the information to dynamically determine optimal Err codemadness.org 70 i 946 estimation strategy for the backends' compute-power. Our scheduling policy Err codemadness.org 70 i 947 generalizes power-of-two-choice algorithms to handle heterogeneous workers, Err codemadness.org 70 i 948 reducing the max queue length of $O(\log n)$ obtained by prior algorithms to Err codemadness.org 70 i 949 $O(\log \log n)$. We implement a Rosella prototype and evaluate it with a Err codemadness.org 70 i 950 variety of workloads. Experimental results show that Rosella significantly Err codemadness.org 70 i 951 reduces task response times, and adapts to environment changes quickly. Err codemadness.org 70 i 952

Err codemadness.org 70 i 953

Ground Roll Suppression using Convolutional Neural Networks. (arXiv:2010.15209v1 [eess.IV])

Seismic data processing plays a major role in seismic exploration as it Err codemadness.org 70 i 960 conditions much of the seismic interpretation performance. In this context, Err codemadness.org 70 i 961 generating reliable post-stack seismic data depends also on disposing of an Err codemadness.org 70 i 962 efficient pre-stack noise attenuation tool. Here we tackle ground roll noise, Err codemadness.org 70 i 963 one of the most challenging and common noises observed in pre-stack seismic Err codemadness.org 70 i 964 data. Since ground roll is characterized by relative low frequencies and high Err codemadness.org 70 i 965 amplitudes, most commonly used approaches for its suppression are based on Err codemadness.org 70 i 966 frequency-amplitude filters for ground roll characteristic bands. However, when Err codemadness.org 70 i 967 signal and noise share the same frequency ranges, these methods usually deliver Err codemadness.org 70 i 968 also signal suppression or residual noise. In this paper we take advantage of Err codemadness.org 70 i 969 the highly non-linear features of convolutional neural networks, and propose to Err codemadness.org 70 i 970 use different architectures to detect ground roll in shot gathers and Err codemadness.org 70 i 971 ultimately to suppress them using conditional generative adversarial networks. Err codemadness.org 70 i 972 Additionally, we propose metrics to evaluate ground roll suppression, and Err codemadness.org 70 i 973 report strong results compared to expert filtering. Finally, we discuss Err codemadness.org 70 i 974 generalization of trained models for similar and different geologies to better Err codemadness.org 70 i 975 understand the feasibility of our proposal in real applications. Err codemadness.org 70 i 976

Err codemadness.org 70 i 977

On Linearizability and the Termination of Randomized Algorithms. (arXiv:2010.15210v1 [cs.DC])

We study the question of whether the "termination with probability 1" Err codemadness.org 70 i 984 property of a randomized algorithm is preserved when one replaces the atomic Err codemadness.org 70 i 985 registers that the algorithm uses with linearizable (implementations of) Err codemadness.org 70 i 986 registers. We show that in general this is not so: roughly speaking, every Err codemadness.org 70 i 987 randomized algorithm A has a corresponding algorithm A' that solves the same Err codemadness.org 70 i 988 problem if the registers that it uses are atomic or strongly-linearizable, but Err codemadness.org 70 i 989 does not terminate if these registers are replaced with "merely" linearizable Err codemadness.org 70 i 990 ones. Together with a previous result shown in [15], this implies that one Err codemadness.org 70 i 991 cannot use the well-known ABD implementation of registers in message-passing Err codemadness.org 70 i 992 systems to automatically transform any randomized algorithm that works in Err codemadness.org 70 i 993 shared-memory systems into a randomized algorithm that works in message-passing Err codemadness.org 70 i 994 systems: with a strong adversary the resulting algorithm may not terminate. Err codemadness.org 70 i 995

Err codemadness.org 70 i 996

Safety-Aware Cascade Controller Tuning Using Constrained Bayesian Optimization. (arXiv:2010.15211v1 [eess.SY])

This paper presents an automated, model-free, data-driven method for the safe Err codemadness.org 70 i 1003 tuning of PID cascade controller gains based on Bayesian optimization. The Err codemadness.org 70 i 1004 optimization objective is composed of data-driven performance metrics and Err codemadness.org 70 i 1005 modeled using Gaussian processes. We further introduce a data-driven constraint Err codemadness.org 70 i 1006 that captures the stability requirements from system data. Numerical evaluation Err codemadness.org 70 i 1007 shows that the proposed approach outperforms relay feedback autotuning and Err codemadness.org 70 i 1008 quickly converges to the global optimum, thanks to a tailored stopping Err codemadness.org 70 i 1009 criterion. We demonstrate the performance of the method in simulations and Err codemadness.org 70 i 1010 experiments on a linear axis drive of a grinding machine. For experimental Err codemadness.org 70 i 1011 implementation, in addition to the introduced safety constraint, we integrate a Err codemadness.org 70 i 1012 method for automatic detection of the critical gains and extend the Err codemadness.org 70 i 1013 optimization objective with a penalty depending on the proximity of the current Err codemadness.org 70 i 1014 candidate points to the critical gains. The resulting automated tuning method Err codemadness.org 70 i 1015 optimizes system performance while ensuring stability and standardization. Err codemadness.org 70 i 1016

Err codemadness.org 70 i 1017

Away from Trolley Problems and Toward Risk Management. (arXiv:2010.15217v1 [cs.CY])

As automated vehicles receive more attention from the media, there has been Err codemadness.org 70 i 1024 an equivalent increase in the coverage of the ethical choices a vehicle may be Err codemadness.org 70 i 1025 forced to make in certain crash situations with no clear safe outcome. Much of Err codemadness.org 70 i 1026 this coverage has focused on a philosophical thought experiment known as the Err codemadness.org 70 i 1027 "trolley problem," and substituting an automated vehicle for the trolley and Err codemadness.org 70 i 1028 the car's software for the bystander. While this is a stark and straightforward Err codemadness.org 70 i 1029 example of ethical decision making for an automated vehicle, it risks Err codemadness.org 70 i 1030 marginalizing the entire field if it is to become the only ethical problem in Err codemadness.org 70 i 1031 the public's mind. In this chapter, I discuss the shortcomings of the trolley Err codemadness.org 70 i 1032 problem, and introduce more nuanced examples that involve crash risk and Err codemadness.org 70 i 1033 uncertainty. Risk management is introduced as an alternative approach, and its Err codemadness.org 70 i 1034 ethical dimensions are discussed. Err codemadness.org 70 i 1035

Err codemadness.org 70 i 1036

StencilFlow: Mapping Large Stencil Programs to Distributed Spatial Computing Systems. (arXiv:2010.15218v1 [cs.DC])

Spatial computing devices have been shown to significantly accelerate stencil Err codemadness.org 70 i 1043 computations, but have so far relied on unrolling the iterative dimension of a Err codemadness.org 70 i 1044 single stencil operation to increase temporal locality. This work considers the Err codemadness.org 70 i 1045 general case of mapping directed acyclic graphs of heterogeneous stencil Err codemadness.org 70 i 1046 computations to spatial computing systems, assuming large input programs Err codemadness.org 70 i 1047 without an iterative component. StencilFlow maximizes temporal locality and Err codemadness.org 70 i 1048 ensures deadlock freedom in this setting, providing end-to-end analysis and Err codemadness.org 70 i 1049 mapping from a high-level program description to distributed hardware. We Err codemadness.org 70 i 1050 evaluate the generated architectures on an FPGA testbed, demonstrating the Err codemadness.org 70 i 1051 highest single-device and multi-device performance recorded for stencil Err codemadness.org 70 i 1052 programs on FPGAs to date, then leverage the framework to study a complex Err codemadness.org 70 i 1053 stencil program from a production weather simulation application. Our work Err codemadness.org 70 i 1054 enables productively targeting distributed spatial computing systems with large Err codemadness.org 70 i 1055 stencil programs, and offers insight into architecture characteristics required Err codemadness.org 70 i 1056 for their efficient execution in practice. Err codemadness.org 70 i 1057

Err codemadness.org 70 i 1058

Geometric Sampling of Networks. (arXiv:2010.15221v1 [math.DG])

Motivated by the methods and results of manifold sampling based on Ricci Err codemadness.org 70 i 1065 curvature, we propose a similar approach for networks. To this end we make Err codemadness.org 70 i 1066 appeal to three types of discrete curvature, namely the graph Forman-, full Err codemadness.org 70 i 1067 Forman- and Haantjes-Ricci curvatures for edge-based and node-based sampling. Err codemadness.org 70 i 1068 We present the results of experiments on real life networks, as well as for Err codemadness.org 70 i 1069 square grids arising in Image Processing. Moreover, we consider fitting Ricci Err codemadness.org 70 i 1070 flows and we employ them for the detection of networks' backbone. We also Err codemadness.org 70 i 1071 develop embedding kernels related to the Forman-Ricci curvatures and employ Err codemadness.org 70 i 1072 them for the detection of the coarse structure of networks, as well as for Err codemadness.org 70 i 1073 network visualization with applications to SVM. The relation between the Ricci Err codemadness.org 70 i 1074 curvature of the original manifold and that of a Ricci curvature driven Err codemadness.org 70 i 1075 discretization is also studied. Err codemadness.org 70 i 1076

Err codemadness.org 70 i 1077

Exploring complex networks with the ICON R package. (arXiv:2010.15222v1 [cs.SI])

We introduce ICON, an R package that contains 1075 complex network datasets Err codemadness.org 70 i 1084 in a standard edgelist format. All provided datasets have associated citations Err codemadness.org 70 i 1085 and have been indexed by the Colorado Index of Complex Networks - also referred Err codemadness.org 70 i 1086 to as ICON. In addition to supplying a large and diverse corpus of useful Err codemadness.org 70 i 1087 real-world networks, ICON also implements an S3 generic to work with the Err codemadness.org 70 i 1088 network and ggnetwork R packages for network analysis and visualization, Err codemadness.org 70 i 1089 respectively. Sample code in this report also demonstrates how ICON can be used Err codemadness.org 70 i 1090 in conjunction with the igraph package. Currently, the Comprehensive R Archive Err codemadness.org 70 i 1091 Network hosts ICON v0.4.0. We hope that ICON will serve as a standard corpus Err codemadness.org 70 i 1092 for complex network research and prevent redundant work that would be otherwise Err codemadness.org 70 i 1093 necessary by individual research groups. The open source code for ICON and for Err codemadness.org 70 i 1094 this reproducible report can be found at https://github.com/rrrlw/ICON. Err codemadness.org 70 i 1095

Err codemadness.org 70 i 1096

A Visuospatial Dataset for Naturalistic Verb Learning. (arXiv:2010.15225v1 [cs.CL])

We introduce a new dataset for training and evaluating grounded language Err codemadness.org 70 i 1103 models. Our data is collected within a virtual reality environment and is Err codemadness.org 70 i 1104 designed to emulate the quality of language data to which a pre-verbal child is Err codemadness.org 70 i 1105 likely to have access: That is, naturalistic, spontaneous speech paired with Err codemadness.org 70 i 1106 richly grounded visuospatial context. We use the collected data to compare Err codemadness.org 70 i 1107 several distributional semantics models for verb learning. We evaluate neural Err codemadness.org 70 i 1108 models based on 2D (pixel) features as well as feature-engineered models based Err codemadness.org 70 i 1109 on 3D (symbolic, spatial) features, and show that neither modeling approach Err codemadness.org 70 i 1110 achieves satisfactory performance. Our results are consistent with evidence Err codemadness.org 70 i 1111 from child language acquisition that emphasizes the difficulty of learning Err codemadness.org 70 i 1112 verbs from naive distributional data. We discuss avenues for future work on Err codemadness.org 70 i 1113 cognitively-inspired grounded language learning, and release our corpus with Err codemadness.org 70 i 1114 the intent of facilitating research on the topic. Err codemadness.org 70 i 1115

Err codemadness.org 70 i 1116

Speech-Based Emotion Recognition using Neural Networks and Information Visualization. (arXiv:2010.15229v1 [cs.HC])

Emotions recognition is commonly employed for health assessment. However, the Err codemadness.org 70 i 1123 typical metric for evaluation in therapy is based on patient-doctor appraisal. Err codemadness.org 70 i 1124 This process can fall into the issue of subjectivity, while also requiring Err codemadness.org 70 i 1125 healthcare professionals to deal with copious amounts of information. Thus, Err codemadness.org 70 i 1126 machine learning algorithms can be a useful tool for the classification of Err codemadness.org 70 i 1127 emotions. While several models have been developed in this domain, there is a Err codemadness.org 70 i 1128 lack of userfriendly representations of the emotion classification systems for Err codemadness.org 70 i 1129 therapy. We propose a tool which enables users to take speech samples and Err codemadness.org 70 i 1130 identify a range of emotions (happy, sad, angry, surprised, neutral, clam, Err codemadness.org 70 i 1131 disgust, and fear) from audio elements through a machine learning model. The Err codemadness.org 70 i 1132 dashboard is designed based on local therapists' needs for intuitive Err codemadness.org 70 i 1133 representations of speech data in order to gain insights and informative Err codemadness.org 70 i 1134 analyses of their sessions with their patients. Err codemadness.org 70 i 1135

Err codemadness.org 70 i 1136

Construction Payment Automation Using Blockchain-Enabled Smart Contracts and Reality Capture Technologies. (arXiv:2010.15232v1 [cs.CR])

This paper presents a smart contract-based solution for autonomous Err codemadness.org 70 i 1143 administration of construction progress payments. It bridges the gap between Err codemadness.org 70 i 1144 payments (cash flow) and the progress assessments at job sites (product flow) Err codemadness.org 70 i 1145 enabled by reality capture technologies and building information modeling Err codemadness.org 70 i 1146 (BIM). The approach eliminates the reliance on the centralized and heavily Err codemadness.org 70 i 1147 intermediated mechanisms of existing payment applications. The construction Err codemadness.org 70 i 1148 progress is stored in a distributed manner using content addressable file Err codemadness.org 70 i 1149 sharing; it is broadcasted to a smart contract which automates the on-chain Err codemadness.org 70 i 1150 payment settlements and the transfer of lien rights. The method was Err codemadness.org 70 i 1151 successfully used for processing payments to 7 subcontractors in two commercial Err codemadness.org 70 i 1152 construction projects where progress monitoring was performed using a Err codemadness.org 70 i 1153 camera-equipped unmanned aerial vehicle (UAV) and an unmanned ground vehicle Err codemadness.org 70 i 1154 (UGV) equipped with a laser scanner. The results show promise for the method's Err codemadness.org 70 i 1155 potential for increasing the frequency, granularity, and transparency of Err codemadness.org 70 i 1156 payments. The paper is concluded with a discussion of implications for project Err codemadness.org 70 i 1157 management, introducing a new model of project as a singleton state machine. Err codemadness.org 70 i 1158

Err codemadness.org 70 i 1159

Accurate Prostate Cancer Detection and Segmentation on Biparametric MRI using Non-local Mask R-CNN with Histopathological Ground Truth. (arXiv:2010.15233v1 [eess.IV])

Purpose: We aimed to develop deep machine learning (DL) models to improve the Err codemadness.org 70 i 1166 detection and segmentation of intraprostatic lesions (IL) on bp-MRI by using Err codemadness.org 70 i 1167 whole amount prostatectomy specimen-based delineations. We also aimed to Err codemadness.org 70 i 1168 investigate whether transfer learning and self-training would improve results Err codemadness.org 70 i 1169 with small amount labelled data. Err codemadness.org 70 i 1170

Err codemadness.org 70 i 1171

Methods: 158 patients had suspicious lesions delineated on MRI based on Err codemadness.org 70 i 1172 bp-MRI, 64 patients had ILs delineated on MRI based on whole mount Err codemadness.org 70 i 1173 prostatectomy specimen sections, 40 patients were unlabelled. A non-local Mask Err codemadness.org 70 i 1174 R-CNN was proposed to improve the segmentation accuracy. Transfer learning was Err codemadness.org 70 i 1175 investigated by fine-tuning a model trained using MRI-based delineations with Err codemadness.org 70 i 1176 prostatectomy-based delineations. Two label selection strategies were Err codemadness.org 70 i 1177 investigated in self-training. The performance of models was evaluated by 3D Err codemadness.org 70 i 1178 detection rate, dice similarity coefficient (DSC), 95 percentile Hausdrauff (95 Err codemadness.org 70 i 1179 HD, mm) and true positive ratio (TPR). Err codemadness.org 70 i 1180

Err codemadness.org 70 i 1181

Results: With prostatectomy-based delineations, the non-local Mask R-CNN with Err codemadness.org 70 i 1182 fine-tuning and self-training significantly improved all evaluation metrics. Err codemadness.org 70 i 1183 For the model with the highest detection rate and DSC, 80.5% (33/41) of lesions Err codemadness.org 70 i 1184 in all Gleason Grade Groups (GGG) were detected with DSC of 0.548[0.165], 95 HD Err codemadness.org 70 i 1185 of 5.72[3.17] and TPR of 0.613[0.193]. Among them, 94.7% (18/19) of lesions Err codemadness.org 70 i 1186 with GGG > 2 were detected with DSC of 0.604[0.135], 95 HD of 6.26[3.44] and Err codemadness.org 70 i 1187 TPR of 0.580[0.190]. Err codemadness.org 70 i 1188

Err codemadness.org 70 i 1189

Conclusion: DL models can achieve high prostate cancer detection and Err codemadness.org 70 i 1190 segmentation accuracy on bp-MRI based on annotations from histologic images. To Err codemadness.org 70 i 1191 further improve the performance, more data with annotations of both MRI and Err codemadness.org 70 i 1192 whole amount prostatectomy specimens are required. Err codemadness.org 70 i 1193

Err codemadness.org 70 i 1194

Linear Regression Games: Convergence Guarantees to Approximate Out-of-Distribution Solutions. (arXiv:2010.15234v1 [cs.LG])

Recently, invariant risk minimization (IRM) (Arjovsky et al.) was proposed as Err codemadness.org 70 i 1201 a promising solution to address out-of-distribution (OOD) generalization. In Err codemadness.org 70 i 1202 Ahuja et al., it was shown that solving for the Nash equilibria of a new class Err codemadness.org 70 i 1203 of "ensemble-games" is equivalent to solving IRM. In this work, we extend the Err codemadness.org 70 i 1204 framework in Ahuja et al. for linear regressions by projecting the Err codemadness.org 70 i 1205 ensemble-game on an $\ell_{\infty}$ ball. We show that such projections help Err codemadness.org 70 i 1206 achieve non-trivial OOD guarantees despite not achieving perfect invariance. Err codemadness.org 70 i 1207 For linear models with confounders, we prove that Nash equilibria of these Err codemadness.org 70 i 1208 games are closer to the ideal OOD solutions than the standard empirical risk Err codemadness.org 70 i 1209 minimization (ERM) and we also provide learning algorithms that provably Err codemadness.org 70 i 1210 converge to these Nash Equilibria. Empirical comparisons of the proposed Err codemadness.org 70 i 1211 approach with the state-of-the-art show consistent gains in achieving OOD Err codemadness.org 70 i 1212 solutions in several settings involving anti-causal variables and confounders. Err codemadness.org 70 i 1213

Err codemadness.org 70 i 1214

SD-Access: Practical Experiences in Designing and Deploying Software Defined Enterprise Networks. (arXiv:2010.15236v1 [cs.NI])

Enterprise Networks, over the years, have become more and more complex trying Err codemadness.org 70 i 1221 to keep up with new requirements that challenge traditional solutions. Just to Err codemadness.org 70 i 1222 mention one out of many possible examples, technologies such as Virtual LANs Err codemadness.org 70 i 1223 (VLANs) struggle to address the scalability and operational requirements Err codemadness.org 70 i 1224 introduced by Internet of Things (IoT) use cases. To keep up with these Err codemadness.org 70 i 1225 challenges we have identified four main requirements that are common across Err codemadness.org 70 i 1226 modern enterprise networks: (i) scalable mobility, (ii) endpoint segmentation, Err codemadness.org 70 i 1227 (iii) simplified administration, and (iv) resource optimization. To address Err codemadness.org 70 i 1228 these challenges we designed SDA (Software Defined Access), a solution for Err codemadness.org 70 i 1229 modern enterprise networks that leverages Software-Defined Networking (SDN) and Err codemadness.org 70 i 1230 other state of the art techniques. In this paper we present the design, Err codemadness.org 70 i 1231 implementation and evaluation of SDA. Specifically, SDA: (i) leverages a Err codemadness.org 70 i 1232 combination of an overlay approach with an event-driven protocol (LISP) to Err codemadness.org 70 i 1233 dynamically adapt to traffic and mobility patterns while preserving resources, Err codemadness.org 70 i 1234 and (ii) enforces dynamic endpoint groups for scalable segmentation with low Err codemadness.org 70 i 1235 operational burden. We present our experience with deploying SDA in two Err codemadness.org 70 i 1236 real-life scenarios: an enterprise campus, and a large warehouse with mobile Err codemadness.org 70 i 1237 robots. Our evaluation shows that SDA, when compared with traditional Err codemadness.org 70 i 1238 enterprise networks, can (i) reduce overall data plane forwarding state up to Err codemadness.org 70 i 1239 70% thanks to a reactive protocol using a centralized routing server, and (ii) Err codemadness.org 70 i 1240 reduce by an order of magnitude the handover delays in scenarios of massive Err codemadness.org 70 i 1241 mobility with respect to other approaches. Finally, we discuss lessons learned Err codemadness.org 70 i 1242 while deploying and operating SDA, and possible optimizations regarding the use Err codemadness.org 70 i 1243 of an event-driven protocol and group-based segmentation. Err codemadness.org 70 i 1244

Err codemadness.org 70 i 1245

Bandit Policies for Reliable Cellular Network Handovers in Extreme Mobility. (arXiv:2010.15237v1 [cs.LG])

The demand for seamless Internet access under extreme user mobility, such as Err codemadness.org 70 i 1252 on high-speed trains and vehicles, has become a norm rather than an exception. Err codemadness.org 70 i 1253 However, the 4G/5G mobile network is not always reliable to meet this demand, Err codemadness.org 70 i 1254 with non-negligible failures during the handover between base stations. A Err codemadness.org 70 i 1255 fundamental challenge of reliability is to balance the exploration of more Err codemadness.org 70 i 1256 measurements for satisfactory handover, and exploitation for timely handover Err codemadness.org 70 i 1257 (before the fast-moving user leaves the serving base station's radio coverage). Err codemadness.org 70 i 1258 This paper formulates this trade-off in extreme mobility as a composition of Err codemadness.org 70 i 1259 two distinct multi-armed bandit problems. We propose Bandit and Threshold Err codemadness.org 70 i 1260 Tuning (BATT) to minimize the regret of handover failures in extreme mobility. Err codemadness.org 70 i 1261 BATT uses $\epsilon$-binary-search to optimize the threshold of the serving Err codemadness.org 70 i 1262 cell's signal strength to initiate the handover procedure with Err codemadness.org 70 i 1263 $\mathcal{O}(\log J \log T)$ regret.It further devises opportunistic Thompson Err codemadness.org 70 i 1264 sampling, which optimizes the sequence of the target cells to measure for Err codemadness.org 70 i 1265 reliable handover with $\mathcal{O}(\log T)$ regret.Our experiment over a real Err codemadness.org 70 i 1266 LTE dataset from Chinese high-speed rails validates significant regret Err codemadness.org 70 i 1267 reduction and a 29.1% handover failure reduction. Err codemadness.org 70 i 1268

Err codemadness.org 70 i 1269

Cloud-Based Dynamic Programming for an Electric City Bus Energy Management Considering Real-Time Passenger Load Prediction. (arXiv:2010.15239v1 [eess.SY])

Electric city bus gains popularity in recent years for its low greenhouse gas Err codemadness.org 70 i 1276 emission, low noise level, etc. Different from a passenger car, the weight of a Err codemadness.org 70 i 1277 city bus varies significantly with different amounts of onboard passengers, Err codemadness.org 70 i 1278 which is not well studied in existing literature. This study proposes a Err codemadness.org 70 i 1279 passenger load prediction model using day-of-week, time-of-day, weather, Err codemadness.org 70 i 1280 temperatures, wind levels, and holiday information as inputs. The average Err codemadness.org 70 i 1281 model, Regression Tree, Gradient Boost Decision Tree, and Neural Networks Err codemadness.org 70 i 1282 models are compared in the passenger load prediction. The Gradient Boost Err codemadness.org 70 i 1283 Decision Tree model is selected due to its best accuracy and high stability. Err codemadness.org 70 i 1284 Given the predicted passenger load, dynamic programming algorithm determines Err codemadness.org 70 i 1285 the optimal power demand for supercapacitor and battery by optimizing the Err codemadness.org 70 i 1286 battery aging and energy usage in the cloud. Then rule extraction is conducted Err codemadness.org 70 i 1287 on dynamic programming results, and the rule is real-time loaded to onboard Err codemadness.org 70 i 1288 controllers of vehicles. The proposed cloud-based dynamic programming and rule Err codemadness.org 70 i 1289 extraction framework with the passenger load prediction shows 4% and 11% fewer Err codemadness.org 70 i 1290 bus operating costs in off-peak and peak hours, respectively. The operating Err codemadness.org 70 i 1291 cost by the proposed framework is less than 1% shy of the dynamic programming Err codemadness.org 70 i 1292 with the true passenger load information. Err codemadness.org 70 i 1293

Err codemadness.org 70 i 1294

Test Set Optimization by Machine Learning Algorithms. (arXiv:2010.15240v1 [cs.LG])

Diagnosis results are highly dependent on the volume of test set. To derive Err codemadness.org 70 i 1301 the most efficient test set, we propose several machine learning based methods Err codemadness.org 70 i 1302 to predict the minimum amount of test data that produces relatively accurate Err codemadness.org 70 i 1303 diagnosis. By collecting outputs from failing circuits, the feature matrix and Err codemadness.org 70 i 1304 label vector are generated, which involves the inference information of the Err codemadness.org 70 i 1305 test termination point. Thus we develop a prediction model to fit the data and Err codemadness.org 70 i 1306 determine when to terminate testing. The considered methods include LASSO and Err codemadness.org 70 i 1307 Support Vector Machine(SVM) where the relationship between goals(label) and Err codemadness.org 70 i 1308 predictors(feature matrix) are considered to be linear in LASSO and nonlinear Err codemadness.org 70 i 1309 in SVM. Numerical results show that SVM reaches a diagnosis accuracy of 90.4% Err codemadness.org 70 i 1310 while deducting the volume of test set by 35.24%. Err codemadness.org 70 i 1311

Err codemadness.org 70 i 1312

A marine radioisotope gamma-ray spectrum analysis method based on Monte Carlo simulation and MLP neural network. (arXiv:2010.15245v1 [physics.ins-det])

A multilayer perceptron (MLP) neural network is built to analyze the Cs-137 Err codemadness.org 70 i 1319 concentration in seawater via gamma-ray spectrums measured by a LaBr3 detector. Err codemadness.org 70 i 1320 The MLP is trained and tested by a large data set generated by combining Err codemadness.org 70 i 1321 measured and Monte Carlo simulated spectrums under the assumption that all the Err codemadness.org 70 i 1322 measured spectrums have 0 Cs-137 concentration. And the performance of MLP is Err codemadness.org 70 i 1323 evaluated and compared with the traditional net-peak area method. The results Err codemadness.org 70 i 1324 show an improvement of 7% in accuracy and 0.036 in the ROC-curve area compared Err codemadness.org 70 i 1325 to those of the net peak area method. And the influence of the assumption of Err codemadness.org 70 i 1326 Cs-137 concentration in the training data set on the classifying performance of Err codemadness.org 70 i 1327 MLP is evaluated. Err codemadness.org 70 i 1328

Err codemadness.org 70 i 1329

Semantic video segmentation for autonomous driving. (arXiv:2010.15250v1 [cs.CV])

We aim to solve semantic video segmentation in autonomous driving, namely Err codemadness.org 70 i 1336 road detection in real time video, using techniques discussed in (Shelhamer et Err codemadness.org 70 i 1337 al., 2016a). While fully convolutional network gives good result, we show that Err codemadness.org 70 i 1338 the speed can be halved while preserving the accuracy. The test dataset being Err codemadness.org 70 i 1339 used is KITTI, which consists of real footage from Germany's streets. Err codemadness.org 70 i 1340

Err codemadness.org 70 i 1341

Fusion Models for Improved Visual Captioning. (arXiv:2010.15251v1 [cs.CV])

Visual captioning aims to generate textual descriptions given images. Err codemadness.org 70 i 1348 Traditionally, the captioning models are trained on human annotated datasets Err codemadness.org 70 i 1349 such as Flickr30k and MS-COCO, which are limited in size and diversity. This Err codemadness.org 70 i 1350 limitation hinders the generalization capabilities of these models while also Err codemadness.org 70 i 1351 rendering them to often make mistakes. Language models can, however, be trained Err codemadness.org 70 i 1352 on vast amounts of freely available unlabelled data and have recently emerged Err codemadness.org 70 i 1353 as successful language encoders and coherent text generators. Meanwhile, Err codemadness.org 70 i 1354 several unimodal and multimodal fusion techniques have been proven to work well Err codemadness.org 70 i 1355 for natural language generation and automatic speech recognition. Building on Err codemadness.org 70 i 1356 these recent developments, and with an aim of improving the quality of Err codemadness.org 70 i 1357 generated captions, the contribution of our work in this paper is two-fold: Err codemadness.org 70 i 1358 First, we propose a generic multimodal model fusion framework for caption Err codemadness.org 70 i 1359 generation as well as emendation where we utilize different fusion strategies Err codemadness.org 70 i 1360 to integrate a pretrained Auxiliary Language Model (AuxLM) within the Err codemadness.org 70 i 1361 traditional encoder-decoder visual captioning frameworks. Next, we employ the Err codemadness.org 70 i 1362 same fusion strategies to integrate a pretrained Masked Language Model (MLM), Err codemadness.org 70 i 1363 namely BERT, with a visual captioning model, viz. Show, Attend, and Tell, for Err codemadness.org 70 i 1364 emending both syntactic and semantic errors in captions. Our caption emendation Err codemadness.org 70 i 1365 experiments on three benchmark image captioning datasets, viz. Flickr8k, Err codemadness.org 70 i 1366 Flickr30k, and MSCOCO, show improvements over the baseline, indicating the Err codemadness.org 70 i 1367 usefulness of our proposed multimodal fusion strategies. Further, we perform a Err codemadness.org 70 i 1368 preliminary qualitative analysis on the emended captions and identify error Err codemadness.org 70 i 1369 categories based on the type of corrections. Err codemadness.org 70 i 1370

Err codemadness.org 70 i 1371

Model Minimization For Online Predictability. (arXiv:2010.15255v1 [cs.AI])

For humans in a teaming scenario, context switching between reasoning about a Err codemadness.org 70 i 1378 teammate's behavior and thinking about thier own task can slow us down, Err codemadness.org 70 i 1379 especially if the cognitive cost of predicting the teammate's actions is high. Err codemadness.org 70 i 1380 So if we can make the prediction of a robot-teammate's actions quicker, then Err codemadness.org 70 i 1381 the human can be more productive. In this paper we present an approach to Err codemadness.org 70 i 1382 constrain the actions of a robot so as to increase predictability (specifically Err codemadness.org 70 i 1383 online predictability) while keeping the plan costs of the robot within Err codemadness.org 70 i 1384 acceptable limits. Existing works on human-robot interaction do not consider Err codemadness.org 70 i 1385 the computational cost for predictability, which we consider in our approach. Err codemadness.org 70 i 1386 We approach this problem from the perspective of directed graph minimization, Err codemadness.org 70 i 1387 and we connect the concept of predictability to the out-degree of vertices. We Err codemadness.org 70 i 1388 present an algorithm to minimize graphs for predictability, and contrast this Err codemadness.org 70 i 1389 with minimization for legibility (goal inference) and optimality. Err codemadness.org 70 i 1390

Err codemadness.org 70 i 1391

DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressors. (arXiv:2010.15258v1 [cs.SD])

Human subjective evaluation is the gold standard to evaluate speech quality Err codemadness.org 70 i 1398 optimized for human perception. Perceptual objective metrics serve as a proxy Err codemadness.org 70 i 1399 for subjective scores. The conventional and widely used metrics require a Err codemadness.org 70 i 1400 reference clean speech signal, which is unavailable in real recordings. The Err codemadness.org 70 i 1401 no-reference approaches correlate poorly with human ratings and are not widely Err codemadness.org 70 i 1402 adopted in the research community. One of the biggest use cases of these Err codemadness.org 70 i 1403 perceptual objective metrics is to evaluate noise suppression algorithms. This Err codemadness.org 70 i 1404 paper introduces a multi-stage self-teaching based perceptual objective metric Err codemadness.org 70 i 1405 that is designed to evaluate noise suppressors. The proposed method generalizes Err codemadness.org 70 i 1406 well in challenging test conditions with a high correlation to human ratings. Err codemadness.org 70 i 1407

Err codemadness.org 70 i 1408

Object sieving and morphological closing to reduce false detections in wide-area aerial imagery. (arXiv:2010.15260v1 [cs.CV])

For object detection in wide-area aerial imagery, post-processing is usually Err codemadness.org 70 i 1415 needed to reduce false detections. We propose a two-stage post-processing Err codemadness.org 70 i 1416 scheme which comprises an area-thresholding sieving process and a morphological Err codemadness.org 70 i 1417 closing operation. We use two wide-area aerial videos to compare the Err codemadness.org 70 i 1418 performance of five object detection algorithms in the absence and in the Err codemadness.org 70 i 1419 presence of our post-processing scheme. The automatic detection results are Err codemadness.org 70 i 1420 compared with the ground-truth objects. Several metrics are used for Err codemadness.org 70 i 1421 performance comparison. Err codemadness.org 70 i 1422

Err codemadness.org 70 i 1423

Deep Shells: Unsupervised Shape Correspondence with Optimal Transport. (arXiv:2010.15261v1 [cs.CV])

We propose a novel unsupervised learning approach to 3D shape correspondence Err codemadness.org 70 i 1430 that builds a multiscale matching pipeline into a deep neural network. This Err codemadness.org 70 i 1431 approach is based on smooth shells, the current state-of-the-art axiomatic Err codemadness.org 70 i 1432 correspondence method, which requires an a priori stochastic search over the Err codemadness.org 70 i 1433 space of initial poses. Our goal is to replace this costly preprocessing step Err codemadness.org 70 i 1434 by directly learning good initializations from the input surfaces. To that end, Err codemadness.org 70 i 1435 we systematically derive a fully differentiable, hierarchical matching pipeline Err codemadness.org 70 i 1436 from entropy regularized optimal transport. This allows us to combine it with a Err codemadness.org 70 i 1437 local feature extractor based on smooth, truncated spectral convolution Err codemadness.org 70 i 1438 filters. Finally, we show that the proposed unsupervised method significantly Err codemadness.org 70 i 1439 improves over the state-of-the-art on multiple datasets, even in comparison to Err codemadness.org 70 i 1440 the most recent supervised methods. Moreover, we demonstrate compelling Err codemadness.org 70 i 1441 generalization results by applying our learned filters to examples that Err codemadness.org 70 i 1442 significantly deviate from the training set. Err codemadness.org 70 i 1443

Err codemadness.org 70 i 1444

CopyNext: Explicit Span Copying and Alignment in Sequence to Sequence Models. (arXiv:2010.15266v1 [cs.CL])

Copy mechanisms are employed in sequence to sequence models (seq2seq) to Err codemadness.org 70 i 1451 generate reproductions of words from the input to the output. These frameworks, Err codemadness.org 70 i 1452 operating at the lexical type level, fail to provide an explicit alignment that Err codemadness.org 70 i 1453 records where each token was copied from. Further, they require contiguous Err codemadness.org 70 i 1454 token sequences from the input (spans) to be copied individually. We present a Err codemadness.org 70 i 1455 model with an explicit token-level copy operation and extend it to copying Err codemadness.org 70 i 1456 entire spans. Our model provides hard alignments between spans in the input and Err codemadness.org 70 i 1457 output, allowing for nontraditional applications of seq2seq, like information Err codemadness.org 70 i 1458 extraction. We demonstrate the approach on Nested Named Entity Recognition, Err codemadness.org 70 i 1459 achieving near state-of-the-art accuracy with an order of magnitude increase in Err codemadness.org 70 i 1460 decoding speed. Err codemadness.org 70 i 1461

Err codemadness.org 70 i 1462

Understanding the Pathologies of Approximate Policy Evaluation when Combined with Greedification in Reinforcement Learning. (arXiv:2010.15268v1 [cs.LG])

Despite empirical success, the theory of reinforcement learning (RL) with Err codemadness.org 70 i 1469 value function approximation remains fundamentally incomplete. Prior work has Err codemadness.org 70 i 1470 identified a variety of pathological behaviours that arise in RL algorithms Err codemadness.org 70 i 1471 that combine approximate on-policy evaluation and greedification. One prominent Err codemadness.org 70 i 1472 example is policy oscillation, wherein an algorithm may cycle indefinitely Err codemadness.org 70 i 1473 between policies, rather than converging to a fixed point. What is not well Err codemadness.org 70 i 1474 understood however is the quality of the policies in the region of oscillation. Err codemadness.org 70 i 1475 In this paper we present simple examples illustrating that in addition to Err codemadness.org 70 i 1476 policy oscillation and multiple fixed points -- the same basic issue can lead Err codemadness.org 70 i 1477 to convergence to the worst possible policy for a given approximation. Such Err codemadness.org 70 i 1478 behaviours can arise when algorithms optimize evaluation accuracy weighted by Err codemadness.org 70 i 1479 the distribution of states that occur under the current policy, but greedify Err codemadness.org 70 i 1480 based on the value of states which are rare or nonexistent under this Err codemadness.org 70 i 1481 distribution. This means the values used for greedification are unreliable and Err codemadness.org 70 i 1482 can steer the policy in undesirable directions. Our observation that this can Err codemadness.org 70 i 1483 lead to the worst possible policy shows that in a general sense such algorithms Err codemadness.org 70 i 1484 are unreliable. The existence of such examples helps to narrow the kind of Err codemadness.org 70 i 1485 theoretical guarantees that are possible and the kind of algorithmic ideas that Err codemadness.org 70 i 1486 are likely to be helpful. We demonstrate analytically and experimentally that Err codemadness.org 70 i 1487 such pathological behaviours can impact a wide range of RL and dynamic Err codemadness.org 70 i 1488 programming algorithms; such behaviours can arise both with and without Err codemadness.org 70 i 1489 bootstrapping, and with linear function approximation as well as with more Err codemadness.org 70 i 1490 complex parameterized functions like neural networks. Err codemadness.org 70 i 1491

Err codemadness.org 70 i 1492

GloFlow: Global Image Alignment for Creation of Whole Slide Images for Pathology from Video. (arXiv:2010.15269v1 [eess.IV])

The application of deep learning to pathology assumes the existence of Err codemadness.org 70 i 1499 digital whole slide images of pathology slides. However, slide digitization is Err codemadness.org 70 i 1500 bottlenecked by the high cost of precise motor stages in slide scanners that Err codemadness.org 70 i 1501 are needed for position information used for slide stitching. We propose Err codemadness.org 70 i 1502 GloFlow, a two-stage method for creating a whole slide image using optical Err codemadness.org 70 i 1503 flow-based image registration with global alignment using a computationally Err codemadness.org 70 i 1504 tractable graph-pruning approach. In the first stage, we train an optical flow Err codemadness.org 70 i 1505 predictor to predict pairwise translations between successive video frames to Err codemadness.org 70 i 1506 approximate a stitch. In the second stage, this approximate stitch is used to Err codemadness.org 70 i 1507 create a neighborhood graph to produce a corrected stitch. On a simulated Err codemadness.org 70 i 1508 dataset of video scans of WSIs, we find that our method outperforms known Err codemadness.org 70 i 1509 approaches to slide-stitching, and stitches WSIs resembling those produced by Err codemadness.org 70 i 1510 slide scanners. Err codemadness.org 70 i 1511

Err codemadness.org 70 i 1512

A globally convergent modified Newton method for the direct minimization of the Ohta-Kawasaki energy with application to the directed self-assembly of diblock copolymers. (arXiv:2010.15271v1 [physics.comp-ph])

We propose a fast and robust scheme for the direct minimization of the Err codemadness.org 70 i 1519 Ohta-Kawasaki energy that characterizes the microphase separation of diblock Err codemadness.org 70 i 1520 copolymer melts. The scheme employs a globally convergent modified Newton Err codemadness.org 70 i 1521 method with line search which is shown to be mass-conservative, Err codemadness.org 70 i 1522 energy-descending, asymptotically quadratically convergent, and three orders of Err codemadness.org 70 i 1523 magnitude more efficient than the commonly-used gradient flow approach. The Err codemadness.org 70 i 1524 regularity and the first-order condition of minimizers are analyzed. A Err codemadness.org 70 i 1525 numerical study of the chemical substrate guided directed self-assembly of Err codemadness.org 70 i 1526 diblock copolymer melts, based on a novel polymer-substrate interaction model Err codemadness.org 70 i 1527 and the proposed scheme, is provided. Err codemadness.org 70 i 1528

Err codemadness.org 70 i 1529

The distribution of inhibitory neurons in the C. elegans connectome facilitates self-optimization of coordinated neural activity. (arXiv:2010.15272v1 [q-bio.NC])

The nervous system of the nematode soil worm Caenorhabditis elegans exhibits Err codemadness.org 70 i 1536 remarkable complexity despite the worm's small size. A general challenge is to Err codemadness.org 70 i 1537 better understand the relationship between neural organization and neural Err codemadness.org 70 i 1538 activity at the system level, including the functional roles of inhibitory Err codemadness.org 70 i 1539 connections. Here we implemented an abstract simulation model of the C. elegans Err codemadness.org 70 i 1540 connectome that approximates the neurotransmitter identity of each neuron, and Err codemadness.org 70 i 1541 we explored the functional role of these physiological differences for neural Err codemadness.org 70 i 1542 activity. In particular, we created a Hopfield neural network in which all of Err codemadness.org 70 i 1543 the worm's neurons characterized by inhibitory neurotransmitters are assigned Err codemadness.org 70 i 1544 inhibitory outgoing connections. Then, we created a control condition in which Err codemadness.org 70 i 1545 the same number of inhibitory connections are arbitrarily distributed across Err codemadness.org 70 i 1546 the network. A comparison of these two conditions revealed that the biological Err codemadness.org 70 i 1547 distribution of inhibitory connections facilitates the self-optimization of Err codemadness.org 70 i 1548 coordinated neural activity compared with an arbitrary distribution of Err codemadness.org 70 i 1549 inhibitory connections. Err codemadness.org 70 i 1550

Err codemadness.org 70 i 1551

Representation learning for improved interpretability and classification accuracy of clinical factors from EEG. (arXiv:2010.15274v1 [cs.LG])

Despite extensive standardization, diagnostic interviews for mental health Err codemadness.org 70 i 1558 disorders encompass substantial subjective judgment. Previous studies have Err codemadness.org 70 i 1559 demonstrated that EEG-based neural measures can function as reliable objective Err codemadness.org 70 i 1560 correlates of depression, or even predictors of depression and its course. Err codemadness.org 70 i 1561 However, their clinical utility has not been fully realized because of 1) the Err codemadness.org 70 i 1562 lack of automated ways to deal with the inherent noise associated with EEG data Err codemadness.org 70 i 1563 at scale, and 2) the lack of knowledge of which aspects of the EEG signal may Err codemadness.org 70 i 1564 be markers of a clinical disorder. Here we adapt an unsupervised pipeline from Err codemadness.org 70 i 1565 the recent deep representation learning literature to address these problems by Err codemadness.org 70 i 1566 1) learning a disentangled representation using $\beta$-VAE to denoise the Err codemadness.org 70 i 1567 signal, and 2) extracting interpretable features associated with a sparse set Err codemadness.org 70 i 1568 of clinical labels using a Symbol-Concept Association Network (SCAN). We Err codemadness.org 70 i 1569 demonstrate that our method is able to outperform the canonical hand-engineered Err codemadness.org 70 i 1570 baseline classification method on a number of factors, including participant Err codemadness.org 70 i 1571 age and depression diagnosis. Furthermore, our method recovers a representation Err codemadness.org 70 i 1572 that can be used to automatically extract denoised Event Related Potentials Err codemadness.org 70 i 1573 (ERPs) from novel, single EEG trajectories, and supports fast supervised Err codemadness.org 70 i 1574 re-mapping to various clinical labels, allowing clinicians to re-use a single Err codemadness.org 70 i 1575 EEG representation regardless of updates to the standardized diagnostic system. Err codemadness.org 70 i 1576 Finally, single factors of the learned disentangled representations often Err codemadness.org 70 i 1577 correspond to meaningful markers of clinical factors, as automatically detected Err codemadness.org 70 i 1578 by SCAN, allowing for human interpretability and post-hoc expert analysis of Err codemadness.org 70 i 1579 the recommendations made by the model. Err codemadness.org 70 i 1580

Err codemadness.org 70 i 1581

A direct method for solving inverse Sturm-Liouville problems. (arXiv:2010.15275v1 [math.NA])

We consider two main inverse Sturm-Liouville problems: the problem of Err codemadness.org 70 i 1588 recovery of the potential and the boundary conditions from two spectra or from Err codemadness.org 70 i 1589 a spectral density function. A simple method for practical solution of such Err codemadness.org 70 i 1590 problems is developed, based on the transmutation operator approach, new Err codemadness.org 70 i 1591 Neumann series of Bessel functions representations for solutions and the Err codemadness.org 70 i 1592 Gelfand-Levitan equation. The method allows one to reduce the inverse Err codemadness.org 70 i 1593 Sturm-Liouville problem directly to a system of linear algebraic equations, Err codemadness.org 70 i 1594 such that the potential is recovered from the first element of the solution Err codemadness.org 70 i 1595 vector. We prove the stability of the method and show its numerical efficiency Err codemadness.org 70 i 1596 with several numerical examples. Err codemadness.org 70 i 1597

Err codemadness.org 70 i 1598

Class-incremental learning: survey and performance evaluation. (arXiv:2010.15277v1 [cs.LG])

For future learning systems incremental learning is desirable, because it Err codemadness.org 70 i 1605 allows for: efficient resource usage by eliminating the need to retrain from Err codemadness.org 70 i 1606 scratch at the arrival of new data; reduced memory usage by preventing or Err codemadness.org 70 i 1607 limiting the amount of data required to be stored -- also important when Err codemadness.org 70 i 1608 privacy limitations are imposed; and learning that more closely resembles human Err codemadness.org 70 i 1609 learning. The main challenge for incremental learning is catastrophic Err codemadness.org 70 i 1610 forgetting, which refers to the precipitous drop in performance on previously Err codemadness.org 70 i 1611 learned tasks after learning a new one. Incremental learning of deep neural Err codemadness.org 70 i 1612 networks has seen explosive growth in recent years. Initial work focused on Err codemadness.org 70 i 1613 task incremental learning, where a task-ID is provided at inference time. Err codemadness.org 70 i 1614 Recently we have seen a shift towards class-incremental learning where the Err codemadness.org 70 i 1615 learner must classify at inference time between all classes seen in previous Err codemadness.org 70 i 1616 tasks without recourse to a task-ID. In this paper, we provide a complete Err codemadness.org 70 i 1617 survey of existing methods for incremental learning, and in particular we Err codemadness.org 70 i 1618 perform an extensive experimental evaluation on twelve class-incremental Err codemadness.org 70 i 1619 methods. We consider several new experimental scenarios, including a comparison Err codemadness.org 70 i 1620 of class-incremental methods on multiple large-scale datasets, investigation Err codemadness.org 70 i 1621 into small and large domain shifts, and comparison on various network Err codemadness.org 70 i 1622 architectures. Err codemadness.org 70 i 1623

Err codemadness.org 70 i 1624

Specification description and verification of multitask hybrid systems in the OTS/CafeOBJ method. (arXiv:2010.15280v1 [cs.SE])

To develop IoT and/or CSP systems, we need consider both continuous data from Err codemadness.org 70 i 1631 physical world and discrete data in computer systems. Such a system is called a Err codemadness.org 70 i 1632 hybrid system. Because of density of continuous data, it is not easy to do Err codemadness.org 70 i 1633 software testing to ensure reliability of hybrid systems. Moreover, the size of Err codemadness.org 70 i 1634 the state space increases exponentially for multitask systems. Formal Err codemadness.org 70 i 1635 descriptions of hybrid systems may help us to verify desired properties of a Err codemadness.org 70 i 1636 given system formally with computer supports. In this paper, we propose a way Err codemadness.org 70 i 1637 to describe a formal specification of a given multitask hybrid system as an Err codemadness.org 70 i 1638 observational transition system in CafeOBJ algebraic specification language and Err codemadness.org 70 i 1639 verify it by the proof score method based on equational reasoning implemented Err codemadness.org 70 i 1640 in CafeOBJ interpreter. Err codemadness.org 70 i 1641

Err codemadness.org 70 i 1642

GENs: Generative Encoding Networks. (arXiv:2010.15283v1 [cs.LG])

Mapping data from and/or onto a known family of distributions has become an Err codemadness.org 70 i 1649 important topic in machine learning and data analysis. Deep generative models Err codemadness.org 70 i 1650 (e.g., generative adversarial networks ) have been used effectively to match Err codemadness.org 70 i 1651 known and unknown distributions. Nonetheless, when the form of the target Err codemadness.org 70 i 1652 distribution is known, analytical methods are advantageous in providing robust Err codemadness.org 70 i 1653 results with provable properties. In this paper, we propose and analyze the use Err codemadness.org 70 i 1654 of nonparametric density methods to estimate the Jensen-Shannon divergence for Err codemadness.org 70 i 1655 matching unknown data distributions to known target distributions, such Err codemadness.org 70 i 1656 Gaussian or mixtures of Gaussians, in latent spaces. This analytical method has Err codemadness.org 70 i 1657 several advantages: better behavior when training sample quantity is low, Err codemadness.org 70 i 1658 provable convergence properties, and relatively few parameters, which can be Err codemadness.org 70 i 1659 derived analytically. Using the proposed method, we enforce the latent Err codemadness.org 70 i 1660 representation of an autoencoder to match a target distribution in a learning Err codemadness.org 70 i 1661 framework that we call a {\em generative encoding network}. Here, we present Err codemadness.org 70 i 1662 the numerical methods; derive the expected distribution of the data in the Err codemadness.org 70 i 1663 latent space; evaluate the properties of the latent space, sample Err codemadness.org 70 i 1664 reconstruction, and generated samples; show the advantages over the adversarial Err codemadness.org 70 i 1665 counterpart; and demonstrate the application of the method in real world. Err codemadness.org 70 i 1666

Err codemadness.org 70 i 1667

Speech-Image Semantic Alignment Does Not Depend on Any Prior Classification Tasks. (arXiv:2010.15288v1 [cs.LG])

Semantically-aligned $(speech, image)$ datasets can be used to explore Err codemadness.org 70 i 1674 "visually-grounded speech". In a majority of existing investigations, features Err codemadness.org 70 i 1675 of an image signal are extracted using neural networks "pre-trained" on other Err codemadness.org 70 i 1676 tasks (e.g., classification on ImageNet). In still others, pre-trained networks Err codemadness.org 70 i 1677 are used to extract audio features prior to semantic embedding. Without Err codemadness.org 70 i 1678 "transfer learning" through pre-trained initialization or pre-trained feature Err codemadness.org 70 i 1679 extraction, previous results have tended to show low rates of recall in $speech Err codemadness.org 70 i 1680 \rightarrow image$ and $image \rightarrow speech$ queries. Err codemadness.org 70 i 1681

Err codemadness.org 70 i 1682

Choosing appropriate neural architectures for encoders in the speech and Err codemadness.org 70 i 1683 image branches and using large datasets, one can obtain competitive recall Err codemadness.org 70 i 1684 rates without any reliance on any pre-trained initialization or feature Err codemadness.org 70 i 1685 extraction: $(speech,image)$ semantic alignment and $speech \rightarrow image$ Err codemadness.org 70 i 1686 and $image \rightarrow speech$ retrieval are canonical tasks worthy of Err codemadness.org 70 i 1687 independent investigation of their own and allow one to explore other Err codemadness.org 70 i 1688 questions---e.g., the size of the audio embedder can be reduced significantly Err codemadness.org 70 i 1689 with little loss of recall rates in $speech \rightarrow image$ and $image Err codemadness.org 70 i 1690 \rightarrow speech$ queries. Err codemadness.org 70 i 1691

Err codemadness.org 70 i 1692

Link inference of noisy delay-coupled networks: Machine learning and opto-electronic experimental tests. (arXiv:2010.15289v1 [nlin.AO])

We devise a machine learning technique to solve the general problem of Err codemadness.org 70 i 1699 inferring network links that have time-delays. The goal is to do this purely Err codemadness.org 70 i 1700 from time-series data of the network nodal states. This task has applications Err codemadness.org 70 i 1701 in fields ranging from applied physics and engineering to neuroscience and Err codemadness.org 70 i 1702 biology. To achieve this, we first train a type of machine learning system Err codemadness.org 70 i 1703 known as reservoir computing to mimic the dynamics of the unknown network. We Err codemadness.org 70 i 1704 formulate and test a technique that uses the trained parameters of the Err codemadness.org 70 i 1705 reservoir system output layer to deduce an estimate of the unknown network Err codemadness.org 70 i 1706 structure. Our technique, by its nature, is non-invasive, but is motivated by Err codemadness.org 70 i 1707 the widely-used invasive network inference method whereby the responses to Err codemadness.org 70 i 1708 active perturbations applied to the network are observed and employed to infer Err codemadness.org 70 i 1709 network links (e.g., knocking down genes to infer gene regulatory networks). We Err codemadness.org 70 i 1710 test this technique on experimental and simulated data from delay-coupled Err codemadness.org 70 i 1711 opto-electronic oscillator networks. We show that the technique often yields Err codemadness.org 70 i 1712 very good results particularly if the system does not exhibit synchrony. We Err codemadness.org 70 i 1713 also find that the presence of dynamical noise can strikingly enhance the Err codemadness.org 70 i 1714 accuracy and ability of our technique, especially in networks that exhibit Err codemadness.org 70 i 1715 synchrony. Err codemadness.org 70 i 1716

Err codemadness.org 70 i 1717

Fact or Factitious? Contextualized Opinion Spam Detection. (arXiv:2010.15296v1 [cs.AI])

In this paper we perform an analytic comparison of a number of techniques Err codemadness.org 70 i 1724 used to detect fake and deceptive online reviews. We apply a number machine Err codemadness.org 70 i 1725 learning approaches found to be effective, and introduce our own approach by Err codemadness.org 70 i 1726 fine-tuning state of the art contextualised embeddings. The results we obtain Err codemadness.org 70 i 1727 show the potential of contextualised embeddings for fake review detection, and Err codemadness.org 70 i 1728 lay the groundwork for future research in this area. Err codemadness.org 70 i 1729

Err codemadness.org 70 i 1730

Analysis of Chorin-Type Projection Methods for the Stochastic Stokes Equations with General Multiplicative Noises. (arXiv:2010.15297v1 [math.NA])

This paper is concerned with numerical analysis of two fully discrete Err codemadness.org 70 i 1737 Chorin-type projection methods for the stochastic Stokes equations with general Err codemadness.org 70 i 1738 non-solenoidal multiplicative noise. The first scheme is the standard Chorin Err codemadness.org 70 i 1739 scheme and the second one is a modified Chorin scheme which is designed by Err codemadness.org 70 i 1740 employing the Helmholtz decomposition on the noise function at each time step Err codemadness.org 70 i 1741 to produce a projected divergence-free noise and a "pseudo pressure" after Err codemadness.org 70 i 1742 combining the original pressure and the curl-free part of the decomposition. Err codemadness.org 70 i 1743 Optimal order rates of the convergence are proved for both velocity and Err codemadness.org 70 i 1744 pressure approximations of these two (semi-discrete) Chorin schemes. It is Err codemadness.org 70 i 1745 crucial to measure the errors in appropriate norms. The fully discrete finite Err codemadness.org 70 i 1746 element methods are formulated by discretizing both semi-discrete Chorin Err codemadness.org 70 i 1747 schemes in space by the standard finite element method. Suboptimal order error Err codemadness.org 70 i 1748 estimates are derived for both fully discrete methods. It is proved that all Err codemadness.org 70 i 1749 spatial error constants contain a growth factor $k^{-1/2}$, where $k$ denotes Err codemadness.org 70 i 1750 the time step size, which explains the deteriorating performance of the Err codemadness.org 70 i 1751 standard Chorin scheme when $k\to 0$ and the space mesh size is fixed as Err codemadness.org 70 i 1752 observed earlier in the numerical tests of [9]. Numerical results are also Err codemadness.org 70 i 1753 provided to guage the performance of the proposed numerical methods and to Err codemadness.org 70 i 1754 validate the sharpness of the theoretical error estimates. Err codemadness.org 70 i 1755

Err codemadness.org 70 i 1756

Uncovering Latent Biases in Text: Method and Application to Peer Review. (arXiv:2010.15300v1 [cs.CL])

Quantifying systematic disparities in numerical quantities such as employment Err codemadness.org 70 i 1763 rates and wages between population subgroups provides compelling evidence for Err codemadness.org 70 i 1764 the existence of societal biases. However, biases in the text written for Err codemadness.org 70 i 1765 members of different subgroups (such as in recommendation letters for male and Err codemadness.org 70 i 1766 non-male candidates), though widely reported anecdotally, remain challenging to Err codemadness.org 70 i 1767 quantify. In this work, we introduce a novel framework to quantify bias in text Err codemadness.org 70 i 1768 caused by the visibility of subgroup membership indicators. We develop a Err codemadness.org 70 i 1769 nonparametric estimation and inference procedure to estimate this bias. We then Err codemadness.org 70 i 1770 formalize an identification strategy to causally link the estimated bias to the Err codemadness.org 70 i 1771 visibility of subgroup membership indicators, provided observations from time Err codemadness.org 70 i 1772 periods both before and after an identity-hiding policy change. We identify an Err codemadness.org 70 i 1773 application wherein "ground truth" bias can be inferred to evaluate our Err codemadness.org 70 i 1774 framework, instead of relying on synthetic or secondary data. Specifically, we Err codemadness.org 70 i 1775 apply our framework to quantify biases in the text of peer reviews from a Err codemadness.org 70 i 1776 reputed machine learning conference before and after the conference adopted a Err codemadness.org 70 i 1777 double-blind reviewing policy. We show evidence of biases in the review ratings Err codemadness.org 70 i 1778 that serves as "ground truth", and show that our proposed framework accurately Err codemadness.org 70 i 1779 detects these biases from the review text without having access to the review Err codemadness.org 70 i 1780 ratings. Err codemadness.org 70 i 1781

Err codemadness.org 70 i 1782

Point Cloud Attribute Compression via Successive Subspace Graph Transform. (arXiv:2010.15302v1 [cs.CV])

Inspired by the recently proposed successive subspace learning (SSL) Err codemadness.org 70 i 1789 principles, we develop a successive subspace graph transform (SSGT) to address Err codemadness.org 70 i 1790 point cloud attribute compression in this work. The octree geometry structure Err codemadness.org 70 i 1791 is utilized to partition the point cloud, where every node of the octree Err codemadness.org 70 i 1792 represents a point cloud subspace with a certain spatial size. We design a Err codemadness.org 70 i 1793 weighted graph with self-loop to describe the subspace and define a graph Err codemadness.org 70 i 1794 Fourier transform based on the normalized graph Laplacian. The transforms are Err codemadness.org 70 i 1795 applied to large point clouds from the leaf nodes to the root node of the Err codemadness.org 70 i 1796 octree recursively, while the represented subspace is expanded from the Err codemadness.org 70 i 1797 smallest one to the whole point cloud successively. It is shown by experimental Err codemadness.org 70 i 1798 results that the proposed SSGT method offers better R-D performances than the Err codemadness.org 70 i 1799 previous Region Adaptive Haar Transform (RAHT) method. Err codemadness.org 70 i 1800

Err codemadness.org 70 i 1801

Automatic joint damage quantification using computer vision and deep learning. (arXiv:2010.15303v1 [cs.CV])

Joint raveled or spalled damage (henceforth called joint damage) can affect Err codemadness.org 70 i 1808 the safety and long-term performance of concrete pavements. It is important to Err codemadness.org 70 i 1809 assess and quantify the joint damage over time to assist in building action Err codemadness.org 70 i 1810 plans for maintenance, predicting maintenance costs, and maximize the concrete Err codemadness.org 70 i 1811 pavement service life. A framework for the accurate, autonomous, and rapid Err codemadness.org 70 i 1812 quantification of joint damage with a low-cost camera is proposed using a Err codemadness.org 70 i 1813 computer vision technique with a deep learning (DL) algorithm. The DL model is Err codemadness.org 70 i 1814 employed to train 263 images of sawcuts with joint damage. The trained DL model Err codemadness.org 70 i 1815 is used for pixel-wise color-masking joint damage in a series of query 2D Err codemadness.org 70 i 1816 images, which are used to reconstruct a 3D image using open-source structure Err codemadness.org 70 i 1817 from motion algorithm. Another damage quantification algorithm using a color Err codemadness.org 70 i 1818 threshold is applied to detect and compute the surface area of the damage in Err codemadness.org 70 i 1819 the 3D reconstructed image. The effectiveness of the framework was validated Err codemadness.org 70 i 1820 through inspecting joint damage at four transverse contraction joints in Err codemadness.org 70 i 1821 Illinois, USA, including three acceptable joints and one unacceptable joint by Err codemadness.org 70 i 1822 visual inspection. The results show the framework achieves 76% recall and 10% Err codemadness.org 70 i 1823 error. Err codemadness.org 70 i 1824

Err codemadness.org 70 i 1825

ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection. (arXiv:2010.15306v1 [eess.AS])

Neural-network (NN)-based methods show high performance in sound event Err codemadness.org 70 i 1832 localization and detection (SELD). Conventional NN-based methods use two Err codemadness.org 70 i 1833 branches for a sound event detection (SED) target and a direction-of-arrival Err codemadness.org 70 i 1834 (DOA) target. The two-branch representation with a single network has to decide Err codemadness.org 70 i 1835 how to balance the two objectives during optimization. Using two networks Err codemadness.org 70 i 1836 dedicated to each task increases system complexity and network size. To address Err codemadness.org 70 i 1837 these problems, we propose an activity-coupled Cartesian DOA (ACCDOA) Err codemadness.org 70 i 1838 representation, which assigns a sound event activity to the length of a Err codemadness.org 70 i 1839 corresponding Cartesian DOA vector. The ACCDOA representation enables us to Err codemadness.org 70 i 1840 solve a SELD task with a single target and has two advantages: avoiding the Err codemadness.org 70 i 1841 necessity of balancing the objectives and model size increase. In experimental Err codemadness.org 70 i 1842 evaluations with the DCASE 2020 Task 3 dataset, the ACCDOA representation Err codemadness.org 70 i 1843 outperformed the two-branch representation in SELD metrics with a smaller Err codemadness.org 70 i 1844 network size. The ACCDOA-based SELD system also performed better than Err codemadness.org 70 i 1845 state-of-the-art SELD systems in terms of localization and location-dependent Err codemadness.org 70 i 1846 detection. Err codemadness.org 70 i 1847

Err codemadness.org 70 i 1848

DeviceTTS: A Small-Footprint, Fast, Stable Network for On-Device Text-to-Speech. (arXiv:2010.15311v1 [eess.AS])

With the number of smart devices increasing, the demand for on-device Err codemadness.org 70 i 1855 text-to-speech (TTS) increases rapidly. In recent years, many prominent Err codemadness.org 70 i 1856 End-to-End TTS methods have been proposed, and have greatly improved the Err codemadness.org 70 i 1857 quality of synthesized speech. However, to ensure the qualified speech, most Err codemadness.org 70 i 1858 TTS systems depend on large and complex neural network models, and it's hard to Err codemadness.org 70 i 1859 deploy these TTS systems on-device. In this paper, a small-footprint, fast, Err codemadness.org 70 i 1860 stable network for on-device TTS is proposed, named as DeviceTTS. DeviceTTS Err codemadness.org 70 i 1861 makes use of a duration predictor as a bridge between encoder and decoder so as Err codemadness.org 70 i 1862 to avoid the problem of words skipping and repeating in Tacotron. As we all Err codemadness.org 70 i 1863 know, model size is a key factor for on-device TTS. For DeviceTTS, Deep Err codemadness.org 70 i 1864 Feedforward Sequential Memory Network (DFSMN) is used as the basic component. Err codemadness.org 70 i 1865 Moreover, to speed up inference, mix-resolution decoder is proposed for balance Err codemadness.org 70 i 1866 the inference speed and speech quality. Experiences are done with WORLD and Err codemadness.org 70 i 1867 LPCNet vocoder. Finally, with only 1.4 million model parameters and 0.099 Err codemadness.org 70 i 1868 GFLOPS, DeviceTTS achieves comparable performance with Tacotron and FastSpeech. Err codemadness.org 70 i 1869 As far as we know, the DeviceTTS can meet the needs of most of the devices in Err codemadness.org 70 i 1870 practical application. Err codemadness.org 70 i 1871

Err codemadness.org 70 i 1872

"where is this relationship going?": Understanding Relationship Trajectories in Narrative Text. (arXiv:2010.15313v1 [cs.CL])

We examine a new commonsense reasoning task: given a narrative describing a Err codemadness.org 70 i 1879 social interaction that centers on two protagonists, systems make inferences Err codemadness.org 70 i 1880 about the underlying relationship trajectory. Specifically, we propose two Err codemadness.org 70 i 1881 evaluation tasks: Relationship Outlook Prediction MCQ and Resolution Prediction Err codemadness.org 70 i 1882 MCQ. In Relationship Outlook Prediction, a system maps an interaction to a Err codemadness.org 70 i 1883 relationship outlook that captures how the interaction is expected to change Err codemadness.org 70 i 1884 the relationship. In Resolution Prediction, a system attributes a given Err codemadness.org 70 i 1885 relationship outlook to a particular resolution that explains the outcome. Err codemadness.org 70 i 1886 These two tasks parallel two real-life questions that people frequently ponder Err codemadness.org 70 i 1887 upon as they navigate different social situations: "where is this relationship Err codemadness.org 70 i 1888 going?" and "how did we end up here?". To facilitate the investigation of human Err codemadness.org 70 i 1889 social relationships through these two tasks, we construct a new dataset, Err codemadness.org 70 i 1890 Social Narrative Tree, which consists of 1250 stories documenting a variety of Err codemadness.org 70 i 1891 daily social interactions. The narratives encode a multitude of social elements Err codemadness.org 70 i 1892 that interweave to give rise to rich commonsense knowledge of how relationships Err codemadness.org 70 i 1893 evolve with respect to social interactions. We establish baseline performances Err codemadness.org 70 i 1894 using language models and the accuracies are significantly lower than human Err codemadness.org 70 i 1895 performance. The results demonstrate that models need to look beyond syntactic Err codemadness.org 70 i 1896 and semantic signals to comprehend complex human relationships. Err codemadness.org 70 i 1897

Err codemadness.org 70 i 1898

Recurrent neural circuits for contour detection. (arXiv:2010.15314v1 [cs.CV])

We introduce a deep recurrent neural network architecture that approximates Err codemadness.org 70 i 1905 visual cortical circuits. We show that this architecture, which we refer to as Err codemadness.org 70 i 1906 the gamma-net, learns to solve contour detection tasks with better sample Err codemadness.org 70 i 1907 efficiency than state-of-the-art feedforward networks, while also exhibiting a Err codemadness.org 70 i 1908 classic perceptual illusion, known as the orientation-tilt illusion. Correcting Err codemadness.org 70 i 1909 this illusion significantly reduces gamma-net contour detection accuracy by Err codemadness.org 70 i 1910 driving it to prefer low-level edges over high-level object boundary contours. Err codemadness.org 70 i 1911 Overall, our study suggests that the orientation-tilt illusion is a byproduct Err codemadness.org 70 i 1912 of neural circuits that help biological visual systems achieve robust and Err codemadness.org 70 i 1913 efficient contour detection, and that incorporating these circuits in Err codemadness.org 70 i 1914 artificial neural networks can improve computer vision. Err codemadness.org 70 i 1915

Err codemadness.org 70 i 1916

Exploring Generative Adversarial Networks for Image-to-Image Translation in STEM Simulation. (arXiv:2010.15315v1 [cs.CV])

The use of accurate scanning transmission electron microscopy (STEM) image Err codemadness.org 70 i 1923 simulation methods require large computation times that can make their use Err codemadness.org 70 i 1924 infeasible for the simulation of many images. Other simulation methods based on Err codemadness.org 70 i 1925 linear imaging models, such as the convolution method, are much faster but are Err codemadness.org 70 i 1926 too inaccurate to be used in application. In this paper, we explore deep Err codemadness.org 70 i 1927 learning models that attempt to translate a STEM image produced by the Err codemadness.org 70 i 1928 convolution method to a prediction of the high accuracy multislice image. We Err codemadness.org 70 i 1929 then compare our results to those of regression methods. We find that using the Err codemadness.org 70 i 1930 deep learning model Generative Adversarial Network (GAN) provides us with the Err codemadness.org 70 i 1931 best results and performs at a similar accuracy level to previous regression Err codemadness.org 70 i 1932 models on the same dataset. Codes and data for this project can be found in Err codemadness.org 70 i 1933 this GitHub repository, https://github.com/uw-cmg/GAN-STEM-Conv2MultiSlice. Err codemadness.org 70 i 1934

Err codemadness.org 70 i 1935

Multiple Sclerosis Severity Classification From Clinical Text. (arXiv:2010.15316v1 [cs.CL])

Multiple Sclerosis (MS) is a chronic, inflammatory and degenerative Err codemadness.org 70 i 1942 neurological disease, which is monitored by a specialist using the Expanded Err codemadness.org 70 i 1943 Disability Status Scale (EDSS) and recorded in unstructured text in the form of Err codemadness.org 70 i 1944 a neurology consult note. An EDSS measurement contains an overall "EDSS" score Err codemadness.org 70 i 1945 and several functional subscores. Typically, expert knowledge is required to Err codemadness.org 70 i 1946 interpret consult notes and generate these scores. Previous approaches used Err codemadness.org 70 i 1947 limited context length Word2Vec embeddings and keyword searches to predict Err codemadness.org 70 i 1948 scores given a consult note, but often failed when scores were not explicitly Err codemadness.org 70 i 1949 stated. In this work, we present MS-BERT, the first publicly available Err codemadness.org 70 i 1950 transformer model trained on real clinical data other than MIMIC. Next, we Err codemadness.org 70 i 1951 present MSBC, a classifier that applies MS-BERT to generate embeddings and Err codemadness.org 70 i 1952 predict EDSS and functional subscores. Lastly, we explore combining MSBC with Err codemadness.org 70 i 1953 other models through the use of Snorkel to generate scores for unlabelled Err codemadness.org 70 i 1954 consult notes. MSBC achieves state-of-the-art performance on all metrics and Err codemadness.org 70 i 1955 prediction tasks and outperforms the models generated from the Snorkel Err codemadness.org 70 i 1956 ensemble. We improve Macro-F1 by 0.12 (to 0.88) for predicting EDSS and on Err codemadness.org 70 i 1957 average by 0.29 (to 0.63) for predicting functional subscores over previous Err codemadness.org 70 i 1958 Word2Vec CNN and rule-based approaches. Err codemadness.org 70 i 1959

Err codemadness.org 70 i 1960

The IQIYI System for Voice Conversion Challenge 2020. (arXiv:2010.15317v1 [cs.SD])

This paper presents the IQIYI voice conversion system (T24) for Voice Err codemadness.org 70 i 1967 Conversion 2020. In the competition, each target speaker has 70 sentences. We Err codemadness.org 70 i 1968 have built an end-to-end voice conversion system based on PPG. First, the ASR Err codemadness.org 70 i 1969 acoustic model calculates the BN feature, which represents the content-related Err codemadness.org 70 i 1970 information in the speech. Then the Mel feature is calculated through an Err codemadness.org 70 i 1971 improved prosody tacotron model. Finally, the Mel spectrum is converted to wav Err codemadness.org 70 i 1972 through an improved LPCNet. The evaluation results show that this system can Err codemadness.org 70 i 1973 achieve better voice conversion effects. In the case of using 16k rather than Err codemadness.org 70 i 1974 24k sampling rate audio, the conversion result is relatively good in Err codemadness.org 70 i 1975 naturalness and similarity. Among them, our best results are in the similarity Err codemadness.org 70 i 1976 evaluation of the Task 2, the 2nd in the ASV-based objective evaluation and the Err codemadness.org 70 i 1977 5th in the subjective evaluation. Err codemadness.org 70 i 1978

Err codemadness.org 70 i 1979

Gaussian Processes Model-based Control of Underactuated Balance Robots. (arXiv:2010.15320v1 [cs.RO])

Ranging from cart-pole systems and autonomous bicycles to bipedal robots, Err codemadness.org 70 i 1986 control of these underactuated balance robots aims to achieve both external Err codemadness.org 70 i 1987 (actuated) subsystem trajectory tracking and internal (unactuated) subsystem Err codemadness.org 70 i 1988 balancing tasks with limited actuation authority. This paper proposes a Err codemadness.org 70 i 1989 learning model-based control framework for underactuated balance robots. The Err codemadness.org 70 i 1990 key idea to simultaneously achieve tracking and balancing tasks is to design Err codemadness.org 70 i 1991 control strategies in slow- and fast-time scales, respectively. In slow-time Err codemadness.org 70 i 1992 scale, model predictive control (MPC) is used to generate the desired internal Err codemadness.org 70 i 1993 subsystem trajectory that encodes the external subsystem tracking performance Err codemadness.org 70 i 1994 and control input. In fast-time scale, the actual internal trajectory is Err codemadness.org 70 i 1995 stabilized to the desired internal trajectory by using an inverse dynamics Err codemadness.org 70 i 1996 controller. The coupling effects between the external and internal subsystems Err codemadness.org 70 i 1997 are captured through the planned internal trajectory profile and the dual Err codemadness.org 70 i 1998 structural properties of the robotic systems. The control design is based on Err codemadness.org 70 i 1999 Gaussian processes (GPs) regression model that are learned from experiments Err codemadness.org 70 i 2000 without need of priori knowledge about the robot dynamics nor successful Err codemadness.org 70 i 2001 balance demonstration. The GPs provide estimates of modeling uncertainties of Err codemadness.org 70 i 2002 the robotic systems and these uncertainty estimations are incorporated in the Err codemadness.org 70 i 2003 MPC design to enhance the control robustness to modeling errors. The Err codemadness.org 70 i 2004 learning-based control design is analyzed with guaranteed stability and Err codemadness.org 70 i 2005 performance. The proposed design is demonstrated by experiments on a Furuta Err codemadness.org 70 i 2006 pendulum and an autonomous bikebot. Err codemadness.org 70 i 2007

Err codemadness.org 70 i 2008

Improvement of EAST Data Acquisition Configuration Management. (arXiv:2010.15322v1 [physics.ins-det])

The data acquisition console is an important component of the EAST data Err codemadness.org 70 i 2015 acquisition system which provides unified data acquisition and long-term data Err codemadness.org 70 i 2016 storage for diagnostics. The data acquisition console is used to manage the Err codemadness.org 70 i 2017 data acquisition configuration information and control the data acquisition Err codemadness.org 70 i 2018 workflow. The data acquisition console has been developed many years, and with Err codemadness.org 70 i 2019 increasing of data acquisition nodes and emergence of new control nodes, the Err codemadness.org 70 i 2020 function of configuration management has become inadequate. It is going to Err codemadness.org 70 i 2021 update the configuration management function of data acquisition console. The Err codemadness.org 70 i 2022 upgraded data acquisition console based on LabVIEW should be oriented to the Err codemadness.org 70 i 2023 data acquisition administrator, with the functions of managing data acquisition Err codemadness.org 70 i 2024 nodes, managing control nodes, setting and publishing configuration parameters, Err codemadness.org 70 i 2025 batch management, database backup, monitoring the status of data acquisition Err codemadness.org 70 i 2026 nodes, controlling the data acquisition workflow, and shot simulation data Err codemadness.org 70 i 2027 acquisition test. The upgraded data acquisition console has been designed and Err codemadness.org 70 i 2028 under testing recently. Err codemadness.org 70 i 2029

Err codemadness.org 70 i 2030

Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depth. (arXiv:2010.15327v1 [cs.LG])

A key factor in the success of deep neural networks is the ability to scale Err codemadness.org 70 i 2037 models to improve performance by varying the architecture depth and width. This Err codemadness.org 70 i 2038 simple property of neural network design has resulted in highly effective Err codemadness.org 70 i 2039 architectures for a variety of tasks. Nevertheless, there is limited Err codemadness.org 70 i 2040 understanding of effects of depth and width on the learned representations. In Err codemadness.org 70 i 2041 this paper, we study this fundamental question. We begin by investigating how Err codemadness.org 70 i 2042 varying depth and width affects model hidden representations, finding a Err codemadness.org 70 i 2043 characteristic block structure in the hidden representations of larger capacity Err codemadness.org 70 i 2044 (wider or deeper) models. We demonstrate that this block structure arises when Err codemadness.org 70 i 2045 model capacity is large relative to the size of the training set, and is Err codemadness.org 70 i 2046 indicative of the underlying layers preserving and propagating the dominant Err codemadness.org 70 i 2047 principal component of their representations. This discovery has important Err codemadness.org 70 i 2048 ramifications for features learned by different models, namely, representations Err codemadness.org 70 i 2049 outside the block structure are often similar across architectures with varying Err codemadness.org 70 i 2050 widths and depths, but the block structure is unique to each model. We analyze Err codemadness.org 70 i 2051 the output predictions of different model architectures, finding that even when Err codemadness.org 70 i 2052 the overall accuracy is similar, wide and deep models exhibit distinctive error Err codemadness.org 70 i 2053 patterns and variations across classes. Err codemadness.org 70 i 2054

Err codemadness.org 70 i 2055

Scalable Attack-Resistant Obfuscation of Logic Circuits. (arXiv:2010.15329v1 [cs.CR])

Hardware IP protection has been one of the most critical areas of research in Err codemadness.org 70 i 2062 the past years. Recently, attacks on hardware IPs (such as reverse engineering Err codemadness.org 70 i 2063 or cloning) have evolved as attackers have developed sophisticated techniques. Err codemadness.org 70 i 2064 Therefore, hardware obfuscation has been introduced as a powerful tool to Err codemadness.org 70 i 2065 protect IPs against piracy attacks. However, many recent attempts to break Err codemadness.org 70 i 2066 existing obfuscation methods have been successful in unlocking the IP and Err codemadness.org 70 i 2067 restoring its functionality. In this paper, we propose SARO, a Scalable Err codemadness.org 70 i 2068 Attack-Resistant Obfuscation that provides a robust functional and structural Err codemadness.org 70 i 2069 design transformation process. SARO treats the target circuit as a graph, and Err codemadness.org 70 i 2070 performs a partitioning algorithm to produce a set of sub-graphs, then applies Err codemadness.org 70 i 2071 our novel Truth Table Transformation (T3) process to each partition. We also Err codemadness.org 70 i 2072 propose the $T3_{metric}$, which is developed to quantify the structural and Err codemadness.org 70 i 2073 functional design transformation level caused by the obfuscation process. We Err codemadness.org 70 i 2074 evaluate SARO on ISCAS85 and EPFL benchmarks, and provide full security and Err codemadness.org 70 i 2075 performance analysis of our proposed framework. Err codemadness.org 70 i 2076

Err codemadness.org 70 i 2077

Learning Sampling Distributions Using Local 3D Workspace Decompositions for Motion Planning in High Dimensions. (arXiv:2010.15335v1 [cs.RO])

Earlier work has shown that reusing experience from prior motion planning Err codemadness.org 70 i 2084 problems can improve the efficiency of similar, future motion planning queries. Err codemadness.org 70 i 2085 However, for robots with many degrees-of-freedom, these methods exhibit poor Err codemadness.org 70 i 2086 generalization across different environments and often require large datasets Err codemadness.org 70 i 2087 that are impractical to gather. We present SPARK and FLAME , two Err codemadness.org 70 i 2088 experience-based frameworks for sampling-based planning applicable to complex Err codemadness.org 70 i 2089 manipulators in 3 D environments. Both combine samplers associated with Err codemadness.org 70 i 2090 features from a workspace decomposition into a global biased sampling Err codemadness.org 70 i 2091 distribution. SPARK decomposes the environment based on exact geometry while Err codemadness.org 70 i 2092 FLAME is more general, and uses an octree-based decomposition obtained from Err codemadness.org 70 i 2093 sensor data. We demonstrate the effectiveness of SPARK and FLAME on a Fetch Err codemadness.org 70 i 2094 robot tasked with challenging pick-and-place manipulation problems. Our Err codemadness.org 70 i 2095 approaches can be trained incrementally and significantly improve performance Err codemadness.org 70 i 2096 with only a handful of examples, generalizing better over diverse tasks and Err codemadness.org 70 i 2097 environments as compared to prior approaches. Err codemadness.org 70 i 2098

Err codemadness.org 70 i 2099

SAR-NAS: Skeleton-based Action Recognition via Neural Architecture Searching. (arXiv:2010.15336v1 [cs.CV])

This paper presents a study of automatic design of neural network Err codemadness.org 70 i 2106 architectures for skeleton-based action recognition. Specifically, we encode a Err codemadness.org 70 i 2107 skeleton-based action instance into a tensor and carefully define a set of Err codemadness.org 70 i 2108 operations to build two types of network cells: normal cells and reduction Err codemadness.org 70 i 2109 cells. The recently developed DARTS (Differentiable Architecture Search) is Err codemadness.org 70 i 2110 adopted to search for an effective network architecture that is built upon the Err codemadness.org 70 i 2111 two types of cells. All operations are 2D based in order to reduce the overall Err codemadness.org 70 i 2112 computation and search space. Experiments on the challenging NTU RGB+D and Err codemadness.org 70 i 2113 Kinectics datasets have verified that most of the networks developed to date Err codemadness.org 70 i 2114 for skeleton-based action recognition are likely not compact and efficient. The Err codemadness.org 70 i 2115 proposed method provides an approach to search for such a compact network that Err codemadness.org 70 i 2116 is able to achieve comparative or even better performance than the Err codemadness.org 70 i 2117 state-of-the-art methods. Err codemadness.org 70 i 2118

Err codemadness.org 70 i 2119

A New "Model-Free" Method Combined with Neural Network for MIMO Systems. (arXiv:2010.15338v1 [eess.SY])

In this brief, a model-free adaptive predictive control (MFAPC) is proposed. Err codemadness.org 70 i 2126 It outperforms the current model-free adaptive control (MFAC) for not only Err codemadness.org 70 i 2127 solving the time delay problem in multiple-input multiple-output (MIMO) systems Err codemadness.org 70 i 2128 but also relaxing the current rigorous assumptions for sake of a wider Err codemadness.org 70 i 2129 applicable range. The most attractive merit of the proposed controller is that Err codemadness.org 70 i 2130 the controller design, performance analysis and applications are easy for Err codemadness.org 70 i 2131 engineers to realize. Furthermore, the problem of how to choose the matrix Err codemadness.org 70 i 2132 {\lambda} is finished by analyzing the function of the closed-loop poles rather Err codemadness.org 70 i 2133 than the previous contraction mapping method. Additionally, in view of the Err codemadness.org 70 i 2134 nonlinear modeling capability and adaptability of neural networks (NNs), we Err codemadness.org 70 i 2135 combine these two classes of algorithms together. The feasibility and several Err codemadness.org 70 i 2136 interesting results of the proposed method are shown in simulations. Err codemadness.org 70 i 2137

Err codemadness.org 70 i 2138

Identifying safe intersection design through unsupervised feature extraction from satellite imagery. (arXiv:2010.15343v1 [cs.CV])

The World Health Organization has listed the design of safer intersections as Err codemadness.org 70 i 2145 a key intervention to reduce global road trauma. This article presents the Err codemadness.org 70 i 2146 first study to systematically analyze the design of all intersections in a Err codemadness.org 70 i 2147 large country, based on aerial imagery and deep learning. Approximately 900,000 Err codemadness.org 70 i 2148 satellite images were downloaded for all intersections in Australia and Err codemadness.org 70 i 2149 customized computer vision techniques emphasized the road infrastructure. A Err codemadness.org 70 i 2150 deep autoencoder extracted high-level features, including the intersection's Err codemadness.org 70 i 2151 type, size, shape, lane markings, and complexity, which were used to cluster Err codemadness.org 70 i 2152 similar designs. An Australian telematics data set linked infrastructure design Err codemadness.org 70 i 2153 to driving behaviors captured during 66 million kilometers of driving. This Err codemadness.org 70 i 2154 showed more frequent hard acceleration events (per vehicle) at four- than Err codemadness.org 70 i 2155 three-way intersections, relatively low hard deceleration frequencies at Err codemadness.org 70 i 2156 T-intersections, and consistently low average speeds on roundabouts. Overall, Err codemadness.org 70 i 2157 domain-specific feature extraction enabled the identification of infrastructure Err codemadness.org 70 i 2158 improvements that could result in safer driving behaviors, potentially reducing Err codemadness.org 70 i 2159 road trauma. Err codemadness.org 70 i 2160

Err codemadness.org 70 i 2161

Sea-Net: Squeeze-And-Excitation Attention Net For Diabetic Retinopathy Grading. (arXiv:2010.15344v1 [cs.CV])

Diabetes is one of the most common disease in individuals. \textit{Diabetic Err codemadness.org 70 i 2168 retinopathy} (DR) is a complication of diabetes, which could lead to blindness. Err codemadness.org 70 i 2169 Automatic DR grading based on retinal images provides a great diagnostic and Err codemadness.org 70 i 2170 prognostic value for treatment planning. However, the subtle differences among Err codemadness.org 70 i 2171 severity levels make it difficult to capture important features using Err codemadness.org 70 i 2172 conventional methods. To alleviate the problems, a new deep learning Err codemadness.org 70 i 2173 architecture for robust DR grading is proposed, referred to as SEA-Net, in Err codemadness.org 70 i 2174 which, spatial attention and channel attention are alternatively carried out Err codemadness.org 70 i 2175 and boosted with each other, improving the classification performance. In Err codemadness.org 70 i 2176 addition, a hybrid loss function is proposed to further maximize the Err codemadness.org 70 i 2177 inter-class distance and reduce the intra-class variability. Experimental Err codemadness.org 70 i 2178 results have shown the effectiveness of the proposed architecture. Err codemadness.org 70 i 2179

Err codemadness.org 70 i 2180

Developing Augmented Reality based Gaming Model to Teach Ethical Education in Primary Schools. (arXiv:2010.15346v1 [cs.CY])

Education sector is adopting new technologies for both teaching and learning Err codemadness.org 70 i 2187 pedagogy. Augmented Reality (AR) is a new technology that can be used in the Err codemadness.org 70 i 2188 educational pedagogy to enhance the engagement with students. Students interact Err codemadness.org 70 i 2189 with AR-based educational material for more visualization and explanation. Err codemadness.org 70 i 2190 Therefore, the use of AR in education is becoming more popular. However, most Err codemadness.org 70 i 2191 researches narrate the use of AR technologies in the field of English, Maths, Err codemadness.org 70 i 2192 Science, Culture, Arts, and History education but the absence of ethical Err codemadness.org 70 i 2193 education is visible. In our paper, we design the system and develop an Err codemadness.org 70 i 2194 AR-based mobile game model in the field of Ethical education for pre-primary Err codemadness.org 70 i 2195 students. Students from pre-primary require more interactive lessons than Err codemadness.org 70 i 2196 theoretical concepts. So, we use AR technology to develop a game which offers Err codemadness.org 70 i 2197 interactive procedures where students can learn with fun and engage with the Err codemadness.org 70 i 2198 context. Finally, we develop a prototype that works with our research Err codemadness.org 70 i 2199 objective. We conclude our paper with future works. Err codemadness.org 70 i 2200

Err codemadness.org 70 i 2201

Distance Invariant Sparse Autoencoder for Wireless Signal Strength Mapping. (arXiv:2010.15347v1 [eess.SP])

Wireless signal strength based localization can enable robust localization Err codemadness.org 70 i 2208 for robots using inexpensive sensors. For this, a location-to-signal-strength Err codemadness.org 70 i 2209 map has to be learned for each access point in the environment. Due to the Err codemadness.org 70 i 2210 ubiquity of Wireless networks in most environments, this can result in tens or Err codemadness.org 70 i 2211 hundreds of maps. To reduce the dimensionality of this problem, we employ Err codemadness.org 70 i 2212 autoencoders, which are a popular unsupervised approach for feature extraction Err codemadness.org 70 i 2213 and data compression. In particular, we propose the use of sparse autoencoders Err codemadness.org 70 i 2214 that learn latent spaces that preserve the relative distance between inputs. Err codemadness.org 70 i 2215 Distance invariance between input and latent spaces allows our system to Err codemadness.org 70 i 2216 successfully learn compact representations that allow precise data Err codemadness.org 70 i 2217 reconstruction but also have a low impact on localization performance when Err codemadness.org 70 i 2218 using maps from the latent space rather than the input space. We demonstrate Err codemadness.org 70 i 2219 the feasibility of our approach by performing experiments in outdoor Err codemadness.org 70 i 2220 environments. Err codemadness.org 70 i 2221

Err codemadness.org 70 i 2222

A Hybrid Position/Force Controller for Joint Robots. (arXiv:2010.15350v1 [cs.RO])

In this paper, we present a hybrid position/force controller for operating Err codemadness.org 70 i 2229 joint robots. The hybrid controller has two goals---motion tracking and force Err codemadness.org 70 i 2230 regulating. As long as these two goals are not mutually exclusive, they can be Err codemadness.org 70 i 2231 decoupled in some way. In this work, we make use of the smooth and invertible Err codemadness.org 70 i 2232 mapping from joint space to task space to decouple the two control goals and Err codemadness.org 70 i 2233 design controllers separately. The traditional motion controller in task space Err codemadness.org 70 i 2234 is used for motion control, while the force controller is designed through Err codemadness.org 70 i 2235 manipulating the desired trajectory to regulate the force indirectly. Two case Err codemadness.org 70 i 2236 studies---contour tracking/polishing surfaces and grabbing boxes with two Err codemadness.org 70 i 2237 robotic arms---are presented to show the efficacy of the hybrid controller, and Err codemadness.org 70 i 2238 simulations with physics engines are carried out to validate the efficacy of Err codemadness.org 70 i 2239 the proposed method. Err codemadness.org 70 i 2240

Err codemadness.org 70 i 2241

An automated and multi-parametric algorithm for objective analysis of meibography images. (arXiv:2010.15352v1 [eess.IV])

Meibography is a non-contact imaging technique used by ophthalmologists to Err codemadness.org 70 i 2248 assist in the evaluation and diagnosis of meibomian gland dysfunction (MGD). Err codemadness.org 70 i 2249 While artificial qualitative analysis of meibography images could lead to low Err codemadness.org 70 i 2250 repeatability and efficiency and multi-parametric analysis is demanding to Err codemadness.org 70 i 2251 offer more comprehensive information in discovering subtle changes of meibomian Err codemadness.org 70 i 2252 glands during MGD progression, we developed an automated and multi-parametric Err codemadness.org 70 i 2253 algorithm for objective and quantitative analysis of meibography images. The Err codemadness.org 70 i 2254 full architecture of the algorithm can be divided into three steps: (1) Err codemadness.org 70 i 2255 segmentation of the tarsal conjunctiva area as the region of interest (ROI); Err codemadness.org 70 i 2256 (2) segmentation and identification of glands within the ROI; and (3) Err codemadness.org 70 i 2257 quantitative multi-parametric analysis including newly defined gland diameter Err codemadness.org 70 i 2258 deformation index (DI), gland tortuosity index (TI), and glands signal index Err codemadness.org 70 i 2259 (SI). To evaluate the performance of the automated algorithm, the similarity Err codemadness.org 70 i 2260 index (k) and the segmentation error including the false positive rate (r_P) Err codemadness.org 70 i 2261 and the false negative rate (r_N) are calculated between the manually defined Err codemadness.org 70 i 2262 ground truth and the automatic segmentations of both the ROI and meibomian Err codemadness.org 70 i 2263 glands of 15 typical meibography images. The feasibility of the algorithm is Err codemadness.org 70 i 2264 demonstrated in analyzing typical meibograhy images. Err codemadness.org 70 i 2265

Err codemadness.org 70 i 2266

Domain decomposition and partitioning methods for mixed finite element discretizations of the Biot system of poroelasticity. (arXiv:2010.15353v1 [math.NA])

We develop non-overlapping domain decomposition methods for the Biot system Err codemadness.org 70 i 2273 of poroelasticity in a mixed form. The solid deformation is modeled with a Err codemadness.org 70 i 2274 mixed three-field formulation with weak stress symmetry. The fluid flow is Err codemadness.org 70 i 2275 modeled with a mixed Darcy formulation. We introduce displacement and pressure Err codemadness.org 70 i 2276 Lagrange multipliers on the subdomain interfaces to impose weakly continuity of Err codemadness.org 70 i 2277 normal stress and normal velocity, respectively. The global problem is reduced Err codemadness.org 70 i 2278 to an interface problem for the Lagrange multipliers, which is solved by a Err codemadness.org 70 i 2279 Krylov space iterative method. We study both monolithic and split methods. In Err codemadness.org 70 i 2280 the monolithic method, a coupled displacement-pressure interface problem is Err codemadness.org 70 i 2281 solved, with each iteration requiring the solution of local Biot problems. We Err codemadness.org 70 i 2282 show that the resulting interface operator is positive definite and analyze the Err codemadness.org 70 i 2283 convergence of the iteration. We further study drained split and fixed stress Err codemadness.org 70 i 2284 Biot splittings, in which case we solve separate interface problems requiring Err codemadness.org 70 i 2285 elasticity and Darcy solves. We analyze the stability of the split Err codemadness.org 70 i 2286 formulations. Numerical experiments are presented to illustrate the convergence Err codemadness.org 70 i 2287 of the domain decomposition methods and compare their accuracy and efficiency. Err codemadness.org 70 i 2288

Err codemadness.org 70 i 2289

Reconfigurable Intelligent Surface Aided Secure Transmission: Outage-Constrained Energy-Efficiency Maximization. (arXiv:2010.15354v1 [cs.IT])

Reconfigurable intelligent surface (RIS) has the potential to significantly Err codemadness.org 70 i 2296 enhance the network secure transmission performance by reconfiguring the Err codemadness.org 70 i 2297 wireless propagation environment. However, due to the passive nature of Err codemadness.org 70 i 2298 eavesdroppers and the cascaded channel brought by the RIS, the eavesdroppers' Err codemadness.org 70 i 2299 channel state information is imperfectly obtained at the base station. Under Err codemadness.org 70 i 2300 the channel uncertainty, the optimal phase-shift, power allocation, and Err codemadness.org 70 i 2301 transmission rate design for secure transmission is currently unknown due to Err codemadness.org 70 i 2302 the difficulty of handling the probabilistic constraint with coupled variables. Err codemadness.org 70 i 2303 To fill this gap, this paper formulates a problem of energy-efficient secure Err codemadness.org 70 i 2304 transmission design while incorporating the probabilistic constraint. By Err codemadness.org 70 i 2305 transforming the probabilistic constraint and decoupling variables, the secure Err codemadness.org 70 i 2306 energy efficiency maximization problem can be solved via alternatively Err codemadness.org 70 i 2307 executing difference-of-convex programming and semidefinite relaxation Err codemadness.org 70 i 2308 technique. To scale the solution to massive antennas and reflecting elements Err codemadness.org 70 i 2309 scenario, a fast first-order algorithm with low complexity is further proposed. Err codemadness.org 70 i 2310 Simulation results show that the proposed first-order algorithm achieves Err codemadness.org 70 i 2311 identical performance to the conventional method but saves at least two orders Err codemadness.org 70 i 2312 of magnitude in computation time. Moreover, the resultant RIS aided secure Err codemadness.org 70 i 2313 transmission significantly improves the energy efficiency compared to baseline Err codemadness.org 70 i 2314 schemes of random phase-shift, fixed phase-shift, and RIS ignoring CSI Err codemadness.org 70 i 2315 uncertainty. Err codemadness.org 70 i 2316

Err codemadness.org 70 i 2317

Financial ticket intelligent recognition system based on deep learning. (arXiv:2010.15356v1 [cs.LG])

Facing the rapid growth in the issuance of financial tickets (or bills, Err codemadness.org 70 i 2324 invoices etc.), traditional manual invoice reimbursement and financial Err codemadness.org 70 i 2325 accounting system are imposing an increasing burden on financial accountants Err codemadness.org 70 i 2326 and consuming excessive manpower. To solve this problem, we proposes an Err codemadness.org 70 i 2327 iterative self-learning Framework of Financial Ticket intelligent Recognition Err codemadness.org 70 i 2328 System (FFTRS), which can support the fast iterative updating and extensibility Err codemadness.org 70 i 2329 of the algorithm model, which are the fundamental requirements for a practical Err codemadness.org 70 i 2330 financial accounting system. In addition, we designed a simple yet efficient Err codemadness.org 70 i 2331 Financial Ticket Faster Detection network (FTFDNet) and an intelligent data Err codemadness.org 70 i 2332 warehouse of financial ticket are designed to strengthen its efficiency and Err codemadness.org 70 i 2333 performance. At present, the system can recognize 194 kinds of financial Err codemadness.org 70 i 2334 tickets and has an automatic iterative optimization mechanism, which means, Err codemadness.org 70 i 2335 with the increase of application time, the types of tickets supported by the Err codemadness.org 70 i 2336 system will continue to increase, and the accuracy of recognition will continue Err codemadness.org 70 i 2337 to improve. Experimental results show that the average recognition accuracy of Err codemadness.org 70 i 2338 the system is 97.07%, and the average running time for a single ticket is Err codemadness.org 70 i 2339 175.67ms. The practical value of the system has been tested in a commercial Err codemadness.org 70 i 2340 application, which makes a beneficial attempt for the deep learning technology Err codemadness.org 70 i 2341 in financial accounting work. Err codemadness.org 70 i 2342

Err codemadness.org 70 i 2343

A stochastic optimization algorithm for analyzing planar central and balanced configurations in the $n$-body problem. (arXiv:2010.15358v1 [math.DS])

A stochastic optimization algorithm for analyzing planar central and balanced Err codemadness.org 70 i 2350 configurations in the $n$-body problem is presented. We find a comprehensive Err codemadness.org 70 i 2351 list of equal mass central configurations satisfying the Morse equality up to Err codemadness.org 70 i 2352 $n=12$. We show some exemplary balanced configurations in the case $n=5$, as Err codemadness.org 70 i 2353 well as some balanced configurations without any axis of symmetry in the cases Err codemadness.org 70 i 2354 $n=4$ and $n=10$. Err codemadness.org 70 i 2355

Err codemadness.org 70 i 2356

Combining Self-Training and Self-Supervised Learning for Unsupervised Disfluency Detection. (arXiv:2010.15360v1 [cs.CL])

Most existing approaches to disfluency detection heavily rely on Err codemadness.org 70 i 2363 human-annotated corpora, which is expensive to obtain in practice. There have Err codemadness.org 70 i 2364 been several proposals to alleviate this issue with, for instance, Err codemadness.org 70 i 2365 self-supervised learning techniques, but they still require human-annotated Err codemadness.org 70 i 2366 corpora. In this work, we explore the unsupervised learning paradigm which can Err codemadness.org 70 i 2367 potentially work with unlabeled text corpora that are cheaper and easier to Err codemadness.org 70 i 2368 obtain. Our model builds upon the recent work on Noisy Student Training, a Err codemadness.org 70 i 2369 semi-supervised learning approach that extends the idea of self-training. Err codemadness.org 70 i 2370 Experimental results on the commonly used English Switchboard test set show Err codemadness.org 70 i 2371 that our approach achieves competitive performance compared to the previous Err codemadness.org 70 i 2372 state-of-the-art supervised systems using contextualized word embeddings (e.g. Err codemadness.org 70 i 2373 BERT and ELECTRA). Err codemadness.org 70 i 2374

Err codemadness.org 70 i 2375

Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender System. (arXiv:2010.15363v1 [cs.IR])

The general aim of the recommender system is to provide personalized Err codemadness.org 70 i 2382 suggestions to users, which is opposed to suggesting popular items. However, Err codemadness.org 70 i 2383 the normal training paradigm, i.e., fitting a recommender model to recover the Err codemadness.org 70 i 2384 user behavior data with pointwise or pairwise loss, makes the model biased Err codemadness.org 70 i 2385 towards popular items. This results in the terrible Matthew effect, making Err codemadness.org 70 i 2386 popular items be more frequently recommended and become even more popular. Err codemadness.org 70 i 2387 Existing work addresses this issue with Inverse Propensity Weighting (IPW), Err codemadness.org 70 i 2388 which decreases the impact of popular items on the training and increases the Err codemadness.org 70 i 2389 impact of long-tail items. Although theoretically sound, IPW methods are highly Err codemadness.org 70 i 2390 sensitive to the weighting strategy, which is notoriously difficult to tune. Err codemadness.org 70 i 2391

Err codemadness.org 70 i 2392

In this work, we explore the popularity bias issue from a novel and Err codemadness.org 70 i 2393 fundamental perspective -- cause-effect. We identify that popularity bias lies Err codemadness.org 70 i 2394 in the direct effect from the item node to the ranking score, such that an Err codemadness.org 70 i 2395 item's intrinsic property is the cause of mistakenly assigning it a higher Err codemadness.org 70 i 2396 ranking score. To eliminate popularity bias, it is essential to answer the Err codemadness.org 70 i 2397 counterfactual question that what the ranking score would be if the model only Err codemadness.org 70 i 2398 uses item property. To this end, we formulate a causal graph to describe the Err codemadness.org 70 i 2399 important cause-effect relations in the recommendation process. During Err codemadness.org 70 i 2400 training, we perform multi-task learning to achieve the contribution of each Err codemadness.org 70 i 2401 cause; during testing, we perform counterfactual inference to remove the effect Err codemadness.org 70 i 2402 of item popularity. Remarkably, our solution amends the learning process of Err codemadness.org 70 i 2403 recommendation which is agnostic to a wide range of models. We demonstrate it Err codemadness.org 70 i 2404 on Matrix Factorization (MF) and LightGCN, which are representative of the Err codemadness.org 70 i 2405 conventional and state-of-the-art model for collaborative filtering. Err codemadness.org 70 i 2406 Experiments on five real-world datasets demonstrate the effectiveness of our Err codemadness.org 70 i 2407 method. Err codemadness.org 70 i 2408

Err codemadness.org 70 i 2409

Online State-Time Trajectory Planning Using Timed-ESDF in Highly Dynamic Environments. (arXiv:2010.15364v1 [cs.RO])

Online state-time trajectory planning in highly dynamic environments remains Err codemadness.org 70 i 2416 an unsolved problem due to the unpredictable motions of moving obstacles and Err codemadness.org 70 i 2417 the curse of dimensionality from the state-time space. Existing state-time Err codemadness.org 70 i 2418 planners are typically implemented based on randomized sampling approaches or Err codemadness.org 70 i 2419 path searching on discretized state graph. The smoothness, path clearance, and Err codemadness.org 70 i 2420 planning efficiency of these planners are usually not satisfying. In this work, Err codemadness.org 70 i 2421 we propose a gradient-based planner over the state-time space for online Err codemadness.org 70 i 2422 trajectory generation in highly dynamic environments. To enable the Err codemadness.org 70 i 2423 gradient-based optimization, we propose a Timed-ESDT that supports distance and Err codemadness.org 70 i 2424 gradient queries with state-time keys. Based on the Timed-ESDT, we also define Err codemadness.org 70 i 2425 a smooth prior and an obstacle likelihood function that is compatible with the Err codemadness.org 70 i 2426 state-time space. The trajectory planning is then formulated to a MAP problem Err codemadness.org 70 i 2427 and solved by an efficient numerical optimizer. Moreover, to improve the Err codemadness.org 70 i 2428 optimality of the planner, we also define a state-time graph and then conduct Err codemadness.org 70 i 2429 path searching on it to find a better initialization for the optimizer. By Err codemadness.org 70 i 2430 integrating the graph searching, the planning quality is significantly Err codemadness.org 70 i 2431 improved. Experiment results on simulated and benchmark datasets show that our Err codemadness.org 70 i 2432 planner can outperform the state-of-the-art methods, demonstrating its Err codemadness.org 70 i 2433 significant advantages over the traditional ones. Err codemadness.org 70 i 2434

Err codemadness.org 70 i 2435

Infinite Time Solutions of Numerical Schemes for Advection Problems. (arXiv:2010.15365v1 [math.NA])

This paper addresses the question whether there are numerical schemes for Err codemadness.org 70 i 2442 constant-coefficient advection problems that can yield convergent solutions for Err codemadness.org 70 i 2443 an infinite time horizon. The motivation is that such methods may serve as Err codemadness.org 70 i 2444 building blocks for long-time accurate solutions in more complex Err codemadness.org 70 i 2445 advection-dominated problems. After establishing a new notion of convergence in Err codemadness.org 70 i 2446 an infinite time limit of numerical methods, we first show that linear methods Err codemadness.org 70 i 2447 cannot meet this convergence criterion. Then we present a new numerical Err codemadness.org 70 i 2448 methodology, based on a nonlinear jet scheme framework. We show that these Err codemadness.org 70 i 2449 methods do satisfy the new convergence criterion, thus establishing that Err codemadness.org 70 i 2450 numerical methods exist that converge on an infinite time horizon, and Err codemadness.org 70 i 2451 demonstrate the long-time accuracy gains incurred by this property. Err codemadness.org 70 i 2452

Err codemadness.org 70 i 2453

Self-supervised Pre-training Reduces Label Permutation Instability of Speech Separation. (arXiv:2010.15366v1 [cs.SD])

Speech separation has been well-developed while there are still problems Err codemadness.org 70 i 2460 waiting to be solved. The main problem we focus on in this paper is the Err codemadness.org 70 i 2461 frequent label permutation switching of permutation invariant training (PIT). Err codemadness.org 70 i 2462 For N-speaker separation, there would be N! possible label permutations. How to Err codemadness.org 70 i 2463 stably select correct label permutations is a long-standing problem. In this Err codemadness.org 70 i 2464 paper, we utilize self-supervised pre-training to stabilize the label Err codemadness.org 70 i 2465 permutations. Among several types of self-supervised tasks, speech enhancement Err codemadness.org 70 i 2466 based pre-training tasks show significant effectiveness in our experiments. Err codemadness.org 70 i 2467 When using off-the-shelf pre-trained models, training duration could be Err codemadness.org 70 i 2468 shortened to one-third to two-thirds. Furthermore, even taking pre-training Err codemadness.org 70 i 2469 time into account, the entire training process could still be shorter without a Err codemadness.org 70 i 2470 performance drop when using a larger batch size. Err codemadness.org 70 i 2471

Err codemadness.org 70 i 2472

Learning Centric Wireless Resource Allocation for Edge Computing: Algorithm and Experiment. (arXiv:2010.15371v1 [cs.IT])

Edge intelligence is an emerging network architecture that integrates Err codemadness.org 70 i 2479 sensing, communication, computing components, and supports various machine Err codemadness.org 70 i 2480 learning applications, where a fundamental communication question is: how to Err codemadness.org 70 i 2481 allocate the limited wireless resources (such as time, energy) to the Err codemadness.org 70 i 2482 simultaneous model training of heterogeneous learning tasks? Existing methods Err codemadness.org 70 i 2483 ignore two important facts: 1) different models have heterogeneous demands on Err codemadness.org 70 i 2484 training data; 2) there is a mismatch between the simulated environment and the Err codemadness.org 70 i 2485 real-world environment. As a result, they could lead to low learning Err codemadness.org 70 i 2486 performance in practice. This paper proposes the learning centric wireless Err codemadness.org 70 i 2487 resource allocation (LCWRA) scheme that maximizes the worst learning Err codemadness.org 70 i 2488 performance of multiple classification tasks. Analysis shows that the optimal Err codemadness.org 70 i 2489 transmission time has an inverse power relationship with respect to the Err codemadness.org 70 i 2490 classification error. Finally, both simulation and experimental results are Err codemadness.org 70 i 2491 provided to verify the performance of the proposed LCWRA scheme and its Err codemadness.org 70 i 2492 robustness in real implementation. Err codemadness.org 70 i 2493

Err codemadness.org 70 i 2494

Learning Personalized Discretionary Lane-Change Initiation for Fully Autonomous Driving Based on Reinforcement Learning. (arXiv:2010.15372v1 [cs.HC])

In this article, the authors present a novel method to learn the personalized Err codemadness.org 70 i 2501 tactic of discretionary lane-change initiation for fully autonomous vehicles Err codemadness.org 70 i 2502 through human-computer interactions. Instead of learning from human-driving Err codemadness.org 70 i 2503 demonstrations, a reinforcement learning technique is employed to learn how to Err codemadness.org 70 i 2504 initiate lane changes from traffic context, the action of a self-driving Err codemadness.org 70 i 2505 vehicle, and in-vehicle user feedback. The proposed offline algorithm rewards Err codemadness.org 70 i 2506 the action-selection strategy when the user gives positive feedback and Err codemadness.org 70 i 2507 penalizes it when negative feedback. Also, a multi-dimensional driving scenario Err codemadness.org 70 i 2508 is considered to represent a more realistic lane-change trade-off. The results Err codemadness.org 70 i 2509 show that the lane-change initiation model obtained by this method can Err codemadness.org 70 i 2510 reproduce the personal lane-change tactic, and the performance of the Err codemadness.org 70 i 2511 customized models (average accuracy 86.1%) is much better than that of the Err codemadness.org 70 i 2512 non-customized models (average accuracy 75.7%). This method allows continuous Err codemadness.org 70 i 2513 improvement of customization for users during fully autonomous driving even Err codemadness.org 70 i 2514 without human-driving experience, which will significantly enhance the user Err codemadness.org 70 i 2515 acceptance of high-level autonomy of self-driving vehicles. Err codemadness.org 70 i 2516

Err codemadness.org 70 i 2517

Solving Sparse Linear Inverse Problems in Communication Systems: A Deep Learning Approach With Adaptive Depth. (arXiv:2010.15376v1 [eess.SP])

Sparse signal recovery problems from noisy linear measurements appear in many Err codemadness.org 70 i 2524 areas of wireless communications. In recent years, deep learning (DL) based Err codemadness.org 70 i 2525 approaches have attracted interests of researchers to solve the sparse linear Err codemadness.org 70 i 2526 inverse problem by unfolding iterative algorithms as neural networks. Err codemadness.org 70 i 2527 Typically, research concerning DL assume a fixed number of network layers. Err codemadness.org 70 i 2528 However, it ignores a key character in traditional iterative algorithms, where Err codemadness.org 70 i 2529 the number of iterations required for convergence changes with varying sparsity Err codemadness.org 70 i 2530 levels. By investigating on the projected gradient descent, we unveil the Err codemadness.org 70 i 2531 drawbacks of the existing DL methods with fixed depth. Then we propose an Err codemadness.org 70 i 2532 end-to-end trainable DL architecture, which involves an extra halting score at Err codemadness.org 70 i 2533 each layer. Therefore, the proposed method learns how many layers to execute to Err codemadness.org 70 i 2534 emit an output, and the network depth is dynamically adjusted for each task in Err codemadness.org 70 i 2535 the inference phase. We conduct experiments using both synthetic data and Err codemadness.org 70 i 2536 applications including random access in massive MTC and massive MIMO channel Err codemadness.org 70 i 2537 estimation, and the results demonstrate the improved efficiency for the Err codemadness.org 70 i 2538 proposed approach. Err codemadness.org 70 i 2539

Err codemadness.org 70 i 2540

Supervised sequential pattern mining of event sequences in sport to identify important patterns of play: an application to rugby union. (arXiv:2010.15377v1 [cs.LG])

Given a set of sequences comprised of time-ordered events, sequential pattern Err codemadness.org 70 i 2547 mining is useful to identify frequent sub-sequences from different sequences or Err codemadness.org 70 i 2548 within the same sequence. However, in sport, these techniques cannot determine Err codemadness.org 70 i 2549 the importance of particular patterns of play to good or bad outcomes, which is Err codemadness.org 70 i 2550 often of greater interest to coaches. In this study, we apply a supervised Err codemadness.org 70 i 2551 sequential pattern mining algorithm called safe pattern pruning (SPP) to 490 Err codemadness.org 70 i 2552 labelled event sequences representing passages of play from one rugby team's Err codemadness.org 70 i 2553 matches from the 2018 Japan Top League, and then evaluate the importance of the Err codemadness.org 70 i 2554 obtained sub-sequences to points-scoring outcomes. Linebreaks, successful Err codemadness.org 70 i 2555 lineouts, regained kicks in play, repeated phase-breakdown play, and failed Err codemadness.org 70 i 2556 opposition exit plays were identified as important patterns of play for the Err codemadness.org 70 i 2557 team scoring. When sequences were labelled with points scoring outcomes for the Err codemadness.org 70 i 2558 opposition teams, opposition team linebreaks, errors made by the team, Err codemadness.org 70 i 2559 opposition team lineouts, and repeated phase-breakdown play by the opposition Err codemadness.org 70 i 2560 team were identified as important patterns of play for the opposition team Err codemadness.org 70 i 2561 scoring. By virtue of its supervised nature and pruning properties, SPP Err codemadness.org 70 i 2562 obtained a greater variety of generally more sophisticated patterns than the Err codemadness.org 70 i 2563 well-known unsupervised PrefixSpan algorithm. Err codemadness.org 70 i 2564

Err codemadness.org 70 i 2565

Collaborative Method for Incremental Learning on Classification and Generation. (arXiv:2010.15378v1 [cs.CV])

Although well-trained deep neural networks have shown remarkable performance Err codemadness.org 70 i 2572 on numerous tasks, they rapidly forget what they have learned as soon as they Err codemadness.org 70 i 2573 begin to learn with additional data with the previous data stop being provided. Err codemadness.org 70 i 2574 In this paper, we introduce a novel algorithm, Incremental Class Learning with Err codemadness.org 70 i 2575 Attribute Sharing (ICLAS), for incremental class learning with deep neural Err codemadness.org 70 i 2576 networks. As one of its component, we also introduce a generative model, Err codemadness.org 70 i 2577 incGAN, which can generate images with increased variety compared with the Err codemadness.org 70 i 2578 training data. Under challenging environment of data deficiency, ICLAS Err codemadness.org 70 i 2579 incrementally trains classification and the generation networks. Since ICLAS Err codemadness.org 70 i 2580 trains both networks, our algorithm can perform multiple times of incremental Err codemadness.org 70 i 2581 class learning. The experiments on MNIST dataset demonstrate the advantages of Err codemadness.org 70 i 2582 our algorithm. Err codemadness.org 70 i 2583

Err codemadness.org 70 i 2584

The Performance Analysis of Generalized Margin Maximizer (GMM) on Separable Data. (arXiv:2010.15379v1 [stat.ML])

Logistic models are commonly used for binary classification tasks. The Err codemadness.org 70 i 2591 success of such models has often been attributed to their connection to Err codemadness.org 70 i 2592 maximum-likelihood estimators. It has been shown that gradient descent Err codemadness.org 70 i 2593 algorithm, when applied on the logistic loss, converges to the max-margin Err codemadness.org 70 i 2594 classifier (a.k.a. hard-margin SVM). The performance of the max-margin Err codemadness.org 70 i 2595 classifier has been recently analyzed. Inspired by these results, in this Err codemadness.org 70 i 2596 paper, we present and study a more general setting, where the underlying Err codemadness.org 70 i 2597 parameters of the logistic model possess certain structures (sparse, Err codemadness.org 70 i 2598 block-sparse, low-rank, etc.) and introduce a more general framework (which is Err codemadness.org 70 i 2599 referred to as "Generalized Margin Maximizer", GMM). While classical max-margin Err codemadness.org 70 i 2600 classifiers minimize the $2$-norm of the parameter vector subject to linearly Err codemadness.org 70 i 2601 separating the data, GMM minimizes any arbitrary convex function of the Err codemadness.org 70 i 2602 parameter vector. We provide a precise analysis of the performance of GMM via Err codemadness.org 70 i 2603 the solution of a system of nonlinear equations. We also provide a detailed Err codemadness.org 70 i 2604 study for three special cases: ($1$) $\ell_2$-GMM that is the max-margin Err codemadness.org 70 i 2605 classifier, ($2$) $\ell_1$-GMM which encourages sparsity, and ($3$) Err codemadness.org 70 i 2606 $\ell_{\infty}$-GMM which is often used when the parameter vector has binary Err codemadness.org 70 i 2607 entries. Our theoretical results are validated by extensive simulation results Err codemadness.org 70 i 2608 across a range of parameter values, problem instances, and model structures. Err codemadness.org 70 i 2609

Err codemadness.org 70 i 2610

Learning to Actively Learn: A Robust Approach. (arXiv:2010.15382v1 [cs.LG])

This work proposes a procedure for designing algorithms for specific adaptive Err codemadness.org 70 i 2617 data collection tasks like active learning and pure-exploration multi-armed Err codemadness.org 70 i 2618 bandits. Unlike the design of traditional adaptive algorithms that rely on Err codemadness.org 70 i 2619 concentration of measure and careful analysis to justify the correctness and Err codemadness.org 70 i 2620 sample complexity of the procedure, our adaptive algorithm is learned via Err codemadness.org 70 i 2621 adversarial training over equivalence classes of problems derived from Err codemadness.org 70 i 2622 information theoretic lower bounds. In particular, a single adaptive learning Err codemadness.org 70 i 2623 algorithm is learned that competes with the best adaptive algorithm learned for Err codemadness.org 70 i 2624 each equivalence class. Our procedure takes as input just the available Err codemadness.org 70 i 2625 queries, set of hypotheses, loss function, and total query budget. This is in Err codemadness.org 70 i 2626 contrast to existing meta-learning work that learns an adaptive algorithm Err codemadness.org 70 i 2627 relative to an explicit, user-defined subset or prior distribution over Err codemadness.org 70 i 2628 problems which can be challenging to define and be mismatched to the instance Err codemadness.org 70 i 2629 encountered at test time. This work is particularly focused on the regime when Err codemadness.org 70 i 2630 the total query budget is very small, such as a few dozen, which is much Err codemadness.org 70 i 2631 smaller than those budgets typically considered by theoretically derived Err codemadness.org 70 i 2632 algorithms. We perform synthetic experiments to justify the stability and Err codemadness.org 70 i 2633 effectiveness of the training procedure, and then evaluate the method on tasks Err codemadness.org 70 i 2634 derived from real data including a noisy 20 Questions game and a joke Err codemadness.org 70 i 2635 recommendation task. Err codemadness.org 70 i 2636

Err codemadness.org 70 i 2637

Prediction-Based Power Oversubscription in Cloud Platforms. (arXiv:2010.15388v1 [cs.DC])

Datacenter designers rely on conservative estimates of IT equipment power Err codemadness.org 70 i 2644 draw to provision resources. This leaves resources underutilized and requires Err codemadness.org 70 i 2645 more datacenters to be built. Prior work has used power capping to shave the Err codemadness.org 70 i 2646 rare power peaks and add more servers to the datacenter, thereby Err codemadness.org 70 i 2647 oversubscribing its resources and lowering capital costs. This works well when Err codemadness.org 70 i 2648 the workloads and their server placements are known. Unfortunately, these Err codemadness.org 70 i 2649 factors are unknown in public clouds, forcing providers to limit the Err codemadness.org 70 i 2650 oversubscription so that performance is never impacted. Err codemadness.org 70 i 2651

Err codemadness.org 70 i 2652

In this paper, we argue that providers can use predictions of workload Err codemadness.org 70 i 2653 performance criticality and virtual machine (VM) resource utilization to Err codemadness.org 70 i 2654 increase oversubscription. This poses many challenges, such as identifying the Err codemadness.org 70 i 2655 performance-critical workloads from black-box VMs, creating support for Err codemadness.org 70 i 2656 criticality-aware power management, and increasing oversubscription while Err codemadness.org 70 i 2657 limiting the impact of capping. We address these challenges for the hardware Err codemadness.org 70 i 2658 and software infrastructures of Microsoft Azure. The results show that we Err codemadness.org 70 i 2659 enable a 2x increase in oversubscription with minimum impact to critical Err codemadness.org 70 i 2660 workloads. Err codemadness.org 70 i 2661

Err codemadness.org 70 i 2662

Learning Audio Embeddings with User Listening Data for Content-based Music Recommendation. (arXiv:2010.15389v1 [cs.SD])

Personalized recommendation on new track releases has always been a Err codemadness.org 70 i 2669 challenging problem in the music industry. To combat this problem, we first Err codemadness.org 70 i 2670 explore user listening history and demographics to construct a user embedding Err codemadness.org 70 i 2671 representing the user's music preference. With the user embedding and audio Err codemadness.org 70 i 2672 data from user's liked and disliked tracks, an audio embedding can be obtained Err codemadness.org 70 i 2673 for each track using metric learning with Siamese networks. For a new track, we Err codemadness.org 70 i 2674 can decide the best group of users to recommend by computing the similarity Err codemadness.org 70 i 2675 between the track's audio embedding and different user embeddings, Err codemadness.org 70 i 2676 respectively. The proposed system yields state-of-the-art performance on Err codemadness.org 70 i 2677 content-based music recommendation tested with millions of users and tracks. Err codemadness.org 70 i 2678 Also, we extract audio embeddings as features for music genre classification Err codemadness.org 70 i 2679 tasks. The results show the generalization ability of our audio embeddings. Err codemadness.org 70 i 2680

Err codemadness.org 70 i 2681

Multitask Bandit Learning through Heterogeneous Feedback Aggregation. (arXiv:2010.15390v1 [cs.LG])

In many real-world applications, multiple agents seek to learn how to perform Err codemadness.org 70 i 2688 highly related yet slightly different tasks in an online bandit learning Err codemadness.org 70 i 2689 protocol. We formulate this problem as the $\epsilon$-multi-player multi-armed Err codemadness.org 70 i 2690 bandit problem, in which a set of players concurrently interact with a set of Err codemadness.org 70 i 2691 arms, and for each arm, the reward distributions for all players are similar Err codemadness.org 70 i 2692 but not necessarily identical. We develop an upper confidence bound-based Err codemadness.org 70 i 2693 algorithm, RobustAgg$(\epsilon)$, that adaptively aggregates rewards collected Err codemadness.org 70 i 2694 by different players. In the setting where an upper bound on the pairwise Err codemadness.org 70 i 2695 similarities of reward distributions between players is known, we achieve Err codemadness.org 70 i 2696 instance-dependent regret guarantees that depend on the amenability of Err codemadness.org 70 i 2697 information sharing across players. We complement these upper bounds with Err codemadness.org 70 i 2698 nearly matching lower bounds. In the setting where pairwise similarities are Err codemadness.org 70 i 2699 unknown, we provide a lower bound, as well as an algorithm that trades off Err codemadness.org 70 i 2700 minimax regret guarantees for adaptivity to unknown similarity structure. Err codemadness.org 70 i 2701

Err codemadness.org 70 i 2702

Robustifying Binary Classification to Adversarial Perturbation. (arXiv:2010.15391v1 [cs.LG])

Despite the enormous success of machine learning models in various Err codemadness.org 70 i 2709 applications, most of these models lack resilience to (even small) Err codemadness.org 70 i 2710 perturbations in their input data. Hence, new methods to robustify machine Err codemadness.org 70 i 2711 learning models seem very essential. To this end, in this paper we consider the Err codemadness.org 70 i 2712 problem of binary classification with adversarial perturbations. Investigating Err codemadness.org 70 i 2713 the solution to a min-max optimization (which considers the worst-case loss in Err codemadness.org 70 i 2714 the presence of adversarial perturbations) we introduce a generalization to the Err codemadness.org 70 i 2715 max-margin classifier which takes into account the power of the adversary in Err codemadness.org 70 i 2716 manipulating the data. We refer to this classifier as the "Robust Max-margin" Err codemadness.org 70 i 2717 (RM) classifier. Under some mild assumptions on the loss function, we Err codemadness.org 70 i 2718 theoretically show that the gradient descent iterates (with sufficiently small Err codemadness.org 70 i 2719 step size) converge to the RM classifier in its direction. Therefore, the RM Err codemadness.org 70 i 2720 classifier can be studied to compute various performance measures (e.g. Err codemadness.org 70 i 2721 generalization error) of binary classification with adversarial perturbations. Err codemadness.org 70 i 2722

Err codemadness.org 70 i 2723

Off-Policy Interval Estimation with Lipschitz Value Iteration. (arXiv:2010.15392v1 [cs.LG])

Off-policy evaluation provides an essential tool for evaluating the effects Err codemadness.org 70 i 2730 of different policies or treatments using only observed data. When applied to Err codemadness.org 70 i 2731 high-stakes scenarios such as medical diagnosis or financial decision-making, Err codemadness.org 70 i 2732 it is crucial to provide provably correct upper and lower bounds of the Err codemadness.org 70 i 2733 expected reward, not just a classical single point estimate, to the end-users, Err codemadness.org 70 i 2734 as executing a poor policy can be very costly. In this work, we propose a Err codemadness.org 70 i 2735 provably correct method for obtaining interval bounds for off-policy evaluation Err codemadness.org 70 i 2736 in a general continuous setting. The idea is to search for the maximum and Err codemadness.org 70 i 2737 minimum values of the expected reward among all the Lipschitz Q-functions that Err codemadness.org 70 i 2738 are consistent with the observations, which amounts to solving a constrained Err codemadness.org 70 i 2739 optimization problem on a Lipschitz function space. We go on to introduce a Err codemadness.org 70 i 2740 Lipschitz value iteration method to monotonically tighten the interval, which Err codemadness.org 70 i 2741 is simple yet efficient and provably convergent. We demonstrate the practical Err codemadness.org 70 i 2742 efficiency of our method on a range of benchmarks. Err codemadness.org 70 i 2743

Err codemadness.org 70 i 2744

Discovery and classification of Twitter bots. (arXiv:2010.15393v1 [cs.SI])

A very large number of people use Online Social Networks daily. Such Err codemadness.org 70 i 2751 platforms thus become attractive targets for agents that seek to gain access to Err codemadness.org 70 i 2752 the attention of large audiences, and influence perceptions or opinions. Err codemadness.org 70 i 2753 Botnets, collections of automated accounts controlled by a single agent, are a Err codemadness.org 70 i 2754 common mechanism for exerting maximum influence. Botnets may be used to better Err codemadness.org 70 i 2755 infiltrate the social graph over time and to create an illusion of community Err codemadness.org 70 i 2756 behavior, amplifying their message and increasing persuasion. Err codemadness.org 70 i 2757

Err codemadness.org 70 i 2758

This paper investigates Twitter botnets, their behavior, their interaction Err codemadness.org 70 i 2759 with user communities and their evolution over time. We analyzed a dense crawl Err codemadness.org 70 i 2760 of a subset of Twitter traffic, amounting to nearly all interactions by Err codemadness.org 70 i 2761 Greek-speaking Twitter users for a period of 36 months. We detected over a Err codemadness.org 70 i 2762 million events where seemingly unrelated accounts tweeted nearly identical Err codemadness.org 70 i 2763 content at nearly the same time. We filtered these concurrent content injection Err codemadness.org 70 i 2764 events and detected a set of 1,850 accounts that repeatedly exhibit this Err codemadness.org 70 i 2765 pattern of behavior, suggesting that they are fully or in part controlled and Err codemadness.org 70 i 2766 orchestrated by the same software. We found botnets that appear for brief Err codemadness.org 70 i 2767 intervals and disappear, as well as botnets that evolve and grow, spanning the Err codemadness.org 70 i 2768 duration of our dataset. We analyze statistical differences between bot Err codemadness.org 70 i 2769 accounts and human users, as well as botnet interaction with user communities Err codemadness.org 70 i 2770 and Twitter trending topics. Err codemadness.org 70 i 2771

Err codemadness.org 70 i 2772

Smart Homes: Security Challenges and Privacy Concerns. (arXiv:2010.15394v1 [cs.CR])

Development and growth of Internet of Things (IoT) technology has Err codemadness.org 70 i 2779 exponentially increased over the course of the last 10 years since its Err codemadness.org 70 i 2780 inception, and as a result has directly influenced the popularity and size of Err codemadness.org 70 i 2781 smart homes. In this article we present the main technologies and applications Err codemadness.org 70 i 2782 that constitute a smart home, we identify the main security and privacy Err codemadness.org 70 i 2783 challenges that smart home face and we provide good practices to mitigate those Err codemadness.org 70 i 2784 threats. Err codemadness.org 70 i 2785

Err codemadness.org 70 i 2786

Channel Estimation and Equalization for CP-OFDM-based OTFS in Fractional Doppler Channels. (arXiv:2010.15396v1 [cs.IT])

Orthogonal time frequency and space (OTFS) modulation is a promising Err codemadness.org 70 i 2793 technology that satisfies high Doppler requirements for future mobile systems. Err codemadness.org 70 i 2794 OTFS modulation encodes information symbols and pilot symbols into the Err codemadness.org 70 i 2795 two-dimensional (2D) delay-Doppler (DD) domain. The received symbols suffer Err codemadness.org 70 i 2796 from inter-Doppler interference (IDI) in the fading channels with fractional Err codemadness.org 70 i 2797 Doppler shifts that are sampled at noninteger indices in the DD domain. IDI has Err codemadness.org 70 i 2798 been treated as an unavoidable effect because the fractional Doppler shifts Err codemadness.org 70 i 2799 cannot be obtained directly from the received pilot symbols. In this paper, we Err codemadness.org 70 i 2800 provide a solution to channel estimation for fractional Doppler channels. The Err codemadness.org 70 i 2801 proposed estimation provides new insight into the OTFS input-output relation in Err codemadness.org 70 i 2802 the DD domain as a 2D circular convolution with a small approximation. Err codemadness.org 70 i 2803 According to the input-output relation, we also provide a low-complexity Err codemadness.org 70 i 2804 channel equalization method using the estimated channel information. We Err codemadness.org 70 i 2805 demonstrate the error performance of the proposed channel estimation and Err codemadness.org 70 i 2806 equalization in several channels by simulations. The simulation results show Err codemadness.org 70 i 2807 that in high-mobility environments, the total system utilizing the proposed Err codemadness.org 70 i 2808 methods outperforms orthogonal frequency division multiplexing (OFDM) with Err codemadness.org 70 i 2809 ideal channel estimation and a conventional channel estimation method using a Err codemadness.org 70 i 2810 pseudo sequence. Err codemadness.org 70 i 2811

Err codemadness.org 70 i 2812

Free-boundary conformal parameterization of point clouds. (arXiv:2010.15399v1 [cs.CG])

With the advancement in 3D scanning technology, there has been a surge of Err codemadness.org 70 i 2819 interest in the use of point clouds in science and engineering. To facilitate Err codemadness.org 70 i 2820 the computations and analyses of point clouds, prior works have considered Err codemadness.org 70 i 2821 parameterizing them onto some simple planar domains with a fixed boundary shape Err codemadness.org 70 i 2822 such as a unit circle or a rectangle. However, the geometry of the fixed shape Err codemadness.org 70 i 2823 may lead to some undesirable distortion in the parameterization. It is Err codemadness.org 70 i 2824 therefore more natural to consider free-boundary conformal parameterizations of Err codemadness.org 70 i 2825 point clouds, which minimize the local geometric distortion of the mapping Err codemadness.org 70 i 2826 without constraining the overall shape. In this work, we propose a novel Err codemadness.org 70 i 2827 approximation scheme of the Laplace--Beltrami operator on point clouds and Err codemadness.org 70 i 2828 utilize it for developing a free-boundary conformal parameterization method for Err codemadness.org 70 i 2829 disk-type point clouds. With the aid of the free-boundary conformal Err codemadness.org 70 i 2830 parameterization, high-quality point cloud meshing can be easily achieved. Err codemadness.org 70 i 2831 Furthermore, we show that using the idea of conformal welding in complex Err codemadness.org 70 i 2832 analysis, the point cloud conformal parameterization can be computed in a Err codemadness.org 70 i 2833 divide-and-conquer manner. Experimental results are presented to demonstrate Err codemadness.org 70 i 2834 the effectiveness of the proposed method. Err codemadness.org 70 i 2835

Err codemadness.org 70 i 2836

On Efficient and Scalable Time-Continuous Spatial Crowdsourcing -- Full Version. (arXiv:2010.15404v1 [cs.DB])

The proliferation of advanced mobile terminals opened up a new crowdsourcing Err codemadness.org 70 i 2843 avenue, spatial crowdsourcing, to utilize the crowd potential to perform Err codemadness.org 70 i 2844 real-world tasks. In this work, we study a new type of spatial crowdsourcing, Err codemadness.org 70 i 2845 called time-continuous spatial crowdsourcing (TCSC in short). It supports broad Err codemadness.org 70 i 2846 applications for long-term continuous spatial data acquisition, ranging from Err codemadness.org 70 i 2847 environmental monitoring to traffic surveillance in citizen science and Err codemadness.org 70 i 2848 crowdsourcing projects. However, due to limited budgets and limited Err codemadness.org 70 i 2849 availability of workers in practice, the data collected is often incomplete, Err codemadness.org 70 i 2850 incurring data deficiency problem. To tackle that, in this work, we first Err codemadness.org 70 i 2851 propose an entropy-based quality metric, which captures the joint effects of Err codemadness.org 70 i 2852 incompletion in data acquisition and the imprecision in data interpolation. Err codemadness.org 70 i 2853 Based on that, we investigate quality-aware task assignment methods for both Err codemadness.org 70 i 2854 single- and multi-task scenarios. We show the NP-hardness of the single-task Err codemadness.org 70 i 2855 case, and design polynomial-time algorithms with guaranteed approximation Err codemadness.org 70 i 2856 ratios. We study novel indexing and pruning techniques for further enhancing Err codemadness.org 70 i 2857 the performance in practice. Then, we extend the solution to multi-task Err codemadness.org 70 i 2858 scenarios and devise a parallel framework for speeding up the process of Err codemadness.org 70 i 2859 optimization. We conduct extensive experiments on both real and synthetic Err codemadness.org 70 i 2860 datasets to show the effectiveness of our proposals. Err codemadness.org 70 i 2861

Err codemadness.org 70 i 2862

Conversation Graph: Data Augmentation, Training and Evaluation for Non-Deterministic Dialogue Management. (arXiv:2010.15411v1 [cs.CL])

Task-oriented dialogue systems typically rely on large amounts of Err codemadness.org 70 i 2869 high-quality training data or require complex handcrafted rules. However, Err codemadness.org 70 i 2870 existing datasets are often limited in size considering the complexity of the Err codemadness.org 70 i 2871 dialogues. Additionally, conventional training signal inference is not suitable Err codemadness.org 70 i 2872 for non-deterministic agent behaviour, i.e. considering multiple actions as Err codemadness.org 70 i 2873 valid in identical dialogue states. We propose the Conversation Graph Err codemadness.org 70 i 2874 (ConvGraph), a graph-based representation of dialogues that can be exploited Err codemadness.org 70 i 2875 for data augmentation, multi-reference training and evaluation of Err codemadness.org 70 i 2876 non-deterministic agents. ConvGraph generates novel dialogue paths to augment Err codemadness.org 70 i 2877 data volume and diversity. Intrinsic and extrinsic evaluation across three Err codemadness.org 70 i 2878 datasets shows that data augmentation and/or multi-reference training with Err codemadness.org 70 i 2879 ConvGraph can improve dialogue success rates by up to 6.4%. Err codemadness.org 70 i 2880

Err codemadness.org 70 i 2881

Measuring and Harnessing Transference in Multi-Task Learning. (arXiv:2010.15413v1 [cs.LG])

Multi-task learning can leverage information learned by one task to benefit Err codemadness.org 70 i 2888 the training of other tasks. Despite this capacity, na\"ive formulations often Err codemadness.org 70 i 2889 degrade performance and in particular, identifying the tasks that would benefit Err codemadness.org 70 i 2890 from co-training remains a challenging design question. In this paper, we Err codemadness.org 70 i 2891 analyze the dynamics of information transfer, or transference, across tasks Err codemadness.org 70 i 2892 throughout training. Specifically, we develop a similarity measure that can Err codemadness.org 70 i 2893 quantify transference among tasks and use this quantity to both better Err codemadness.org 70 i 2894 understand the optimization dynamics of multi-task learning as well as improve Err codemadness.org 70 i 2895 overall learning performance. In the latter case, we propose two methods to Err codemadness.org 70 i 2896 leverage our transference metric. The first operates at a macro-level by Err codemadness.org 70 i 2897 selecting which tasks should train together while the second functions at a Err codemadness.org 70 i 2898 micro-level by determining how to combine task gradients at each training step. Err codemadness.org 70 i 2899 We find these methods can lead to significant improvement over prior work on Err codemadness.org 70 i 2900 three supervised multi-task learning benchmarks and one multi-task Err codemadness.org 70 i 2901 reinforcement learning paradigm. Err codemadness.org 70 i 2902

Err codemadness.org 70 i 2903

A Novel Anomaly Detection Algorithm for Hybrid Production Systems based on Deep Learning and Timed Automata. (arXiv:2010.15415v1 [cs.LG])

Performing anomaly detection in hybrid systems is a challenging task since it Err codemadness.org 70 i 2910 requires analysis of timing behavior and mutual dependencies of both discrete Err codemadness.org 70 i 2911 and continuous signals. Typically, it requires modeling system behavior, which Err codemadness.org 70 i 2912 is often accomplished manually by human engineers. Using machine learning for Err codemadness.org 70 i 2913 creating a behavioral model from observations has advantages, such as lower Err codemadness.org 70 i 2914 development costs and fewer requirements for specific knowledge about the Err codemadness.org 70 i 2915 system. The paper presents DAD:DeepAnomalyDetection, a new approach for Err codemadness.org 70 i 2916 automatic model learning and anomaly detection in hybrid production systems. It Err codemadness.org 70 i 2917 combines deep learning and timed automata for creating behavioral model from Err codemadness.org 70 i 2918 observations. The ability of deep belief nets to extract binary features from Err codemadness.org 70 i 2919 real-valued inputs is used for transformation of continuous to discrete Err codemadness.org 70 i 2920 signals. These signals, together with the original discrete signals are than Err codemadness.org 70 i 2921 handled in an identical way. Anomaly detection is performed by the comparison Err codemadness.org 70 i 2922 of actual and predicted system behavior. The algorithm has been applied to few Err codemadness.org 70 i 2923 data sets including two from real systems and has shown promising results. Err codemadness.org 70 i 2924

Err codemadness.org 70 i 2925

ProCAN: Progressive Growing Channel Attentive Non-Local Network for Lung Nodule Classification. (arXiv:2010.15417v1 [eess.IV])

Lung cancer classification in screening computed tomography (CT) scans is one Err codemadness.org 70 i 2932 of the most crucial tasks for early detection of this disease. Many lives can Err codemadness.org 70 i 2933 be saved if we are able to accurately classify malignant/ cancerous lung Err codemadness.org 70 i 2934 nodules. Consequently, several deep learning based models have been proposed Err codemadness.org 70 i 2935 recently to classify lung nodules as malignant or benign. Nevertheless, the Err codemadness.org 70 i 2936 large variation in the size and heterogeneous appearance of the nodules makes Err codemadness.org 70 i 2937 this task an extremely challenging one. We propose a new Progressive Growing Err codemadness.org 70 i 2938 Channel Attentive Non-Local (ProCAN) network for lung nodule classification. Err codemadness.org 70 i 2939 The proposed method addresses this challenge from three different aspects. Err codemadness.org 70 i 2940 First, we enrich the Non-Local network by adding channel-wise attention Err codemadness.org 70 i 2941 capability to it. Second, we apply Curriculum Learning principles, whereby we Err codemadness.org 70 i 2942 first train our model on easy examples before hard/ difficult ones. Third, as Err codemadness.org 70 i 2943 the classification task gets harder during the Curriculum learning, our model Err codemadness.org 70 i 2944 is progressively grown to increase its capability of handling the task at hand. Err codemadness.org 70 i 2945 We examined our proposed method on two different public datasets and compared Err codemadness.org 70 i 2946 its performance with state-of-the-art methods in the literature. The results Err codemadness.org 70 i 2947 show that the ProCAN model outperforms state-of-the-art methods and achieves an Err codemadness.org 70 i 2948 AUC of 98.05% and accuracy of 95.28% on the LIDC-IDRI dataset. Moreover, we Err codemadness.org 70 i 2949 conducted extensive ablation studies to analyze the contribution and effects of Err codemadness.org 70 i 2950 each new component of our proposed method. Err codemadness.org 70 i 2951

Err codemadness.org 70 i 2952

Scalable Graph Neural Networks via Bidirectional Propagation. (arXiv:2010.15421v1 [cs.LG])

Graph Neural Networks (GNN) is an emerging field for learning on Err codemadness.org 70 i 2959 non-Euclidean data. Recently, there has been increased interest in designing Err codemadness.org 70 i 2960 GNN that scales to large graphs. Most existing methods use "graph sampling" or Err codemadness.org 70 i 2961 "layer-wise sampling" techniques to reduce training time. However, these Err codemadness.org 70 i 2962 methods still suffer from degrading performance and scalability problems when Err codemadness.org 70 i 2963 applying to graphs with billions of edges. This paper presents GBP, a scalable Err codemadness.org 70 i 2964 GNN that utilizes a localized bidirectional propagation process from both the Err codemadness.org 70 i 2965 feature vectors and the training/testing nodes. Theoretical analysis shows that Err codemadness.org 70 i 2966 GBP is the first method that achieves sub-linear time complexity for both the Err codemadness.org 70 i 2967 precomputation and the training phases. An extensive empirical study Err codemadness.org 70 i 2968 demonstrates that GBP achieves state-of-the-art performance with significantly Err codemadness.org 70 i 2969 less training/testing time. Most notably, GBP can deliver superior performance Err codemadness.org 70 i 2970 on a graph with over 60 million nodes and 1.8 billion edges in less than half Err codemadness.org 70 i 2971 an hour on a single machine. Err codemadness.org 70 i 2972

Err codemadness.org 70 i 2973

Tilde at WMT 2020: News Task Systems. (arXiv:2010.15423v1 [cs.CL])

This paper describes Tilde's submission to the WMT2020 shared task on news Err codemadness.org 70 i 2980 translation for both directions of the English-Polish language pair in both the Err codemadness.org 70 i 2981 constrained and the unconstrained tracks. We follow our submissions from the Err codemadness.org 70 i 2982 previous years and build our baseline systems to be morphologically motivated Err codemadness.org 70 i 2983 sub-word unit-based Transformer base models that we train using the Marian Err codemadness.org 70 i 2984 machine translation toolkit. Additionally, we experiment with different Err codemadness.org 70 i 2985 parallel and monolingual data selection schemes, as well as sampled Err codemadness.org 70 i 2986 back-translation. Our final models are ensembles of Transformer base and Err codemadness.org 70 i 2987 Transformer big models that feature right-to-left re-ranking. Err codemadness.org 70 i 2988

Err codemadness.org 70 i 2989

Detection of asteroid trails in Hubble Space Telescope images using Deep Learning. (arXiv:2010.15425v1 [astro-ph.IM])

We present an application of Deep Learning for the image recognition of Err codemadness.org 70 i 2996 asteroid trails in single-exposure photos taken by the Hubble Space Telescope. Err codemadness.org 70 i 2997 Using algorithms based on multi-layered deep Convolutional Neural Networks, we Err codemadness.org 70 i 2998 report accuracies of above 80% on the validation set. Our project was motivated Err codemadness.org 70 i 2999 by the Hubble Asteroid Hunter project on Zooniverse, which focused on Err codemadness.org 70 i 3000 identifying these objects in order to localize and better characterize them. We Err codemadness.org 70 i 3001 aim to demonstrate that Machine Learning techniques can be very useful in Err codemadness.org 70 i 3002 trying to solve problems that are closely related to Astronomy and Err codemadness.org 70 i 3003 Astrophysics, but that they are still not developed enough for very specific Err codemadness.org 70 i 3004 tasks. Err codemadness.org 70 i 3005

Err codemadness.org 70 i 3006

Physics-informed deep learning for flow and deformation in poroelastic media. (arXiv:2010.15426v1 [cs.CE])

A physics-informed neural network is presented for poroelastic problems with Err codemadness.org 70 i 3013 coupled flow and deformation processes. The governing equilibrium and mass Err codemadness.org 70 i 3014 balance equations are discussed and specific derivations for two-dimensional Err codemadness.org 70 i 3015 cases are presented. A fully-connected deep neural network is used for Err codemadness.org 70 i 3016 training. Barry and Mercer's source problem with time-dependent fluid Err codemadness.org 70 i 3017 injection/extraction in an idealized poroelastic medium, which has an exact Err codemadness.org 70 i 3018 analytical solution, is used as a numerical example. A random sample from the Err codemadness.org 70 i 3019 analytical solution is used as training data and the performance of the model Err codemadness.org 70 i 3020 is tested by predicting the solution on the entire domain after training. The Err codemadness.org 70 i 3021 deep learning model predicts the horizontal and vertical deformations well Err codemadness.org 70 i 3022 while the error in the predicted pore pressure predictions is slightly higher Err codemadness.org 70 i 3023 because of the sparsity of the pore pressure values. Err codemadness.org 70 i 3024

Err codemadness.org 70 i 3025

Sparse Signal Reconstruction for Nonlinear Models via Piecewise Rational Optimization. (arXiv:2010.15427v1 [math.OC])

We propose a method to reconstruct sparse signals degraded by a nonlinear Err codemadness.org 70 i 3032 distortion and acquired at a limited sampling rate. Our method formulates the Err codemadness.org 70 i 3033 reconstruction problem as a nonconvex minimization of the sum of a data fitting Err codemadness.org 70 i 3034 term and a penalization term. In contrast with most previous works which settle Err codemadness.org 70 i 3035 for approximated local solutions, we seek for a global solution to the obtained Err codemadness.org 70 i 3036 challenging nonconvex problem. Our global approach relies on the so-called Err codemadness.org 70 i 3037 Lasserre relaxation of polynomial optimization. We here specifically include in Err codemadness.org 70 i 3038 our approach the case of piecewise rational functions, which makes it possible Err codemadness.org 70 i 3039 to address a wide class of nonconvex exact and continuous relaxations of the Err codemadness.org 70 i 3040 $\ell_0$ penalization function. Additionally, we study the complexity of the Err codemadness.org 70 i 3041 optimization problem. It is shown how to use the structure of the problem to Err codemadness.org 70 i 3042 lighten the computational burden efficiently. Finally, numerical simulations Err codemadness.org 70 i 3043 illustrate the benefits of our method in terms of both global optimality and Err codemadness.org 70 i 3044 signal reconstruction. Err codemadness.org 70 i 3045

Err codemadness.org 70 i 3046

Self-paced Data Augmentation for Training Neural Networks. (arXiv:2010.15434v1 [cs.LG])

Data augmentation is widely used for machine learning; however, an effective Err codemadness.org 70 i 3053 method to apply data augmentation has not been established even though it Err codemadness.org 70 i 3054 includes several factors that should be tuned carefully. One such factor is Err codemadness.org 70 i 3055 sample suitability, which involves selecting samples that are suitable for data Err codemadness.org 70 i 3056 augmentation. A typical method that applies data augmentation to all training Err codemadness.org 70 i 3057 samples disregards sample suitability, which may reduce classifier performance. Err codemadness.org 70 i 3058 To address this problem, we propose the self-paced augmentation (SPA) to Err codemadness.org 70 i 3059 automatically and dynamically select suitable samples for data augmentation Err codemadness.org 70 i 3060 when training a neural network. The proposed method mitigates the deterioration Err codemadness.org 70 i 3061 of generalization performance caused by ineffective data augmentation. We Err codemadness.org 70 i 3062 discuss two reasons the proposed SPA works relative to curriculum learning and Err codemadness.org 70 i 3063 desirable changes to loss function instability. Experimental results Err codemadness.org 70 i 3064 demonstrate that the proposed SPA can improve the generalization performance, Err codemadness.org 70 i 3065 particularly when the number of training samples is small. In addition, the Err codemadness.org 70 i 3066 proposed SPA outperforms the state-of-the-art RandAugment method. Err codemadness.org 70 i 3067

Err codemadness.org 70 i 3068

Group-Harmonic and Group-Closeness Maximization -- Approximation and Engineering. (arXiv:2010.15435v1 [cs.DS])

Centrality measures characterize important nodes in networks. Efficiently Err codemadness.org 70 i 3075 computing such nodes has received a lot of attention. When considering the Err codemadness.org 70 i 3076 generalization of computing central groups of nodes, challenging optimization Err codemadness.org 70 i 3077 problems occur. In this work, we study two such problems, group-harmonic Err codemadness.org 70 i 3078 maximization and group-closeness maximization both from a theoretical and from Err codemadness.org 70 i 3079 an algorithm engineering perspective. Err codemadness.org 70 i 3080

Err codemadness.org 70 i 3081

On the theoretical side, we obtain the following results. For group-harmonic Err codemadness.org 70 i 3082 maximization, unless $P=NP$, there is no polynomial-time algorithm that Err codemadness.org 70 i 3083 achieves an approximation factor better than $1-1/e$ (directed) and $1-1/(4e)$ Err codemadness.org 70 i 3084 (undirected), even for unweighted graphs. On the positive side, we show that a Err codemadness.org 70 i 3085 greedy algorithm achieves an approximation factor of $\lambda(1-2/e)$ Err codemadness.org 70 i 3086 (directed) and $\lambda(1-1/e)/2$ (undirected), where $\lambda$ is the ratio of Err codemadness.org 70 i 3087 minimal and maximal edge weights. For group-closeness maximization, the Err codemadness.org 70 i 3088 undirected case is $NP$-hard to be approximated to within a factor better than Err codemadness.org 70 i 3089 $1-1/(e+1)$ and a constant approximation factor is achieved by a local-search Err codemadness.org 70 i 3090 algorithm. For the directed case, however, we show that, for any Err codemadness.org 70 i 3091 $\epsilon<1/2$, the problem is $NP$-hard to be approximated within a factor of Err codemadness.org 70 i 3092 $4|V|^{-\epsilon}$. Err codemadness.org 70 i 3093

Err codemadness.org 70 i 3094

From the algorithm engineering perspective, we provide efficient Err codemadness.org 70 i 3095 implementations of the above greedy and local search algorithms. In our Err codemadness.org 70 i 3096 experimental study we show that, on small instances where an optimum solution Err codemadness.org 70 i 3097 can be computed in reasonable time, the quality of both the greedy and the Err codemadness.org 70 i 3098 local search algorithms come very close to the optimum. On larger instances, Err codemadness.org 70 i 3099 our local search algorithms yield results with superior quality compared to Err codemadness.org 70 i 3100 existing greedy and local search solutions, at the cost of additional running Err codemadness.org 70 i 3101 time. We thus advocate local search for scenarios where solution quality is of Err codemadness.org 70 i 3102 highest concern. Err codemadness.org 70 i 3103

Err codemadness.org 70 i 3104

Affordance-Aware Handovers with Human Arm Mobility Constraints. (arXiv:2010.15436v1 [cs.RO])

Reasoning about object handover configurations allows an assistive agent to Err codemadness.org 70 i 3111 estimate the appropriateness of handover for a receiver with different arm Err codemadness.org 70 i 3112 mobility capacities. While there are existing approaches to estimating the Err codemadness.org 70 i 3113 effectiveness of handovers, their findings are limited to users without arm Err codemadness.org 70 i 3114 mobility impairments and to specific objects. Therefore, current Err codemadness.org 70 i 3115 state-of-the-art approaches are unable to hand over novel objects to receivers Err codemadness.org 70 i 3116 with different arm mobility capacities. We propose a method that generalises Err codemadness.org 70 i 3117 handover behaviours to previously unseen objects, subject to the constraint of Err codemadness.org 70 i 3118 a user's arm mobility levels and the task context. We propose a Err codemadness.org 70 i 3119 heuristic-guided hierarchically optimised cost whose optimisation adapts object Err codemadness.org 70 i 3120 configurations for receivers with low arm mobility. This also ensures that the Err codemadness.org 70 i 3121 robot grasps consider the context of the user's upcoming task, i.e., the usage Err codemadness.org 70 i 3122 of the object. To understand preferences over handover configurations, we Err codemadness.org 70 i 3123 report on the findings of an online study, wherein we presented different Err codemadness.org 70 i 3124 handover methods, including ours, to $259$ users with different levels of arm Err codemadness.org 70 i 3125 mobility. We encapsulate these preferences in a SRL that is able to reason Err codemadness.org 70 i 3126 about the most suitable handover configuration given a receiver's arm mobility Err codemadness.org 70 i 3127 and upcoming task. We find that people's preferences over handover methods are Err codemadness.org 70 i 3128 correlated to their arm mobility capacities. In experiments with a PR2 robotic Err codemadness.org 70 i 3129 platform, we obtained an average handover accuracy of $90.8\%$ when Err codemadness.org 70 i 3130 generalising handovers to novel objects. Err codemadness.org 70 i 3131

Err codemadness.org 70 i 3132

Memory Attentive Fusion: External Language Model Integration for Transformer-based Sequence-to-Sequence Model. (arXiv:2010.15437v1 [cs.CL])

This paper presents a novel fusion method for integrating an external Err codemadness.org 70 i 3139 language model (LM) into the Transformer based sequence-to-sequence (seq2seq) Err codemadness.org 70 i 3140 model. While paired data are basically required to train the seq2seq model, the Err codemadness.org 70 i 3141 external LM can be trained with only unpaired data. Thus, it is important to Err codemadness.org 70 i 3142 leverage memorized knowledge in the external LM for building the seq2seq model, Err codemadness.org 70 i 3143 since it is hard to prepare a large amount of paired data. However, the Err codemadness.org 70 i 3144 existing fusion methods assume that the LM is integrated with recurrent neural Err codemadness.org 70 i 3145 network-based seq2seq models instead of the Transformer. Therefore, this paper Err codemadness.org 70 i 3146 proposes a fusion method that can explicitly utilize network structures in the Err codemadness.org 70 i 3147 Transformer. The proposed method, called {\bf memory attentive fusion}, Err codemadness.org 70 i 3148 leverages the Transformer-style attention mechanism that repeats source-target Err codemadness.org 70 i 3149 attention in a multi-hop manner for reading the memorized knowledge in the LM. Err codemadness.org 70 i 3150 Our experiments on two text-style conversion tasks demonstrate that the Err codemadness.org 70 i 3151 proposed method performs better than conventional fusion methods. Err codemadness.org 70 i 3152

Err codemadness.org 70 i 3153

Modeling and Control of COVID-19 Epidemic through Testing Policies. (arXiv:2010.15438v1 [math.OC])

Testing for the infected cases is one of the most important mechanisms to Err codemadness.org 70 i 3160 control an epidemic. It enables to isolate the detected infected individuals, Err codemadness.org 70 i 3161 thereby limiting the disease transmission to the susceptible population. Err codemadness.org 70 i 3162 However, despite the significance of testing policies, the recent literature on Err codemadness.org 70 i 3163 the subject lacks a control-theoretic perspective. In this work, an epidemic Err codemadness.org 70 i 3164 model that incorporates the testing rate as a control input is presented. The Err codemadness.org 70 i 3165 proposed model differentiates the undetected infected from the detected Err codemadness.org 70 i 3166 infected cases, who are assumed to be removed from the disease spreading Err codemadness.org 70 i 3167 process in the population. First, the model is estimated and validated for Err codemadness.org 70 i 3168 COVID-19 data in France. Then, two testing policies are proposed, the so-called Err codemadness.org 70 i 3169 best-effort strategy for testing (BEST) and constant optimal strategy for Err codemadness.org 70 i 3170 testing (COST). The BEST policy is a suppression strategy that provides a lower Err codemadness.org 70 i 3171 bound on the testing rate such that the epidemic switches from a spreading to a Err codemadness.org 70 i 3172 non-spreading state. The COST policy is a mitigation strategy that provides an Err codemadness.org 70 i 3173 optimal value of testing rate that minimizes the peak value of the infected Err codemadness.org 70 i 3174 population when the total stockpile of tests is limited. Both testing policies Err codemadness.org 70 i 3175 are evaluated by predicting the number of active intensive care unit (ICU) Err codemadness.org 70 i 3176 cases and the cumulative number of deaths due to COVID-19. Err codemadness.org 70 i 3177

Err codemadness.org 70 i 3178

FlatNet: Towards Photorealistic Scene Reconstruction from Lensless Measurements. (arXiv:2010.15440v1 [eess.IV])

Lensless imaging has emerged as a potential solution towards realizing Err codemadness.org 70 i 3185 ultra-miniature cameras by eschewing the bulky lens in a traditional camera. Err codemadness.org 70 i 3186 Without a focusing lens, the lensless cameras rely on computational algorithms Err codemadness.org 70 i 3187 to recover the scenes from multiplexed measurements. However, the current Err codemadness.org 70 i 3188 iterative-optimization-based reconstruction algorithms produce noisier and Err codemadness.org 70 i 3189 perceptually poorer images. In this work, we propose a non-iterative deep Err codemadness.org 70 i 3190 learning based reconstruction approach that results in orders of magnitude Err codemadness.org 70 i 3191 improvement in image quality for lensless reconstructions. Our approach, called Err codemadness.org 70 i 3192 $\textit{FlatNet}$, lays down a framework for reconstructing high-quality Err codemadness.org 70 i 3193 photorealistic images from mask-based lensless cameras, where the camera's Err codemadness.org 70 i 3194 forward model formulation is known. FlatNet consists of two stages: (1) an Err codemadness.org 70 i 3195 inversion stage that maps the measurement into a space of intermediate Err codemadness.org 70 i 3196 reconstruction by learning parameters within the forward model formulation, and Err codemadness.org 70 i 3197 (2) a perceptual enhancement stage that improves the perceptual quality of this Err codemadness.org 70 i 3198 intermediate reconstruction. These stages are trained together in an end-to-end Err codemadness.org 70 i 3199 manner. We show high-quality reconstructions by performing extensive Err codemadness.org 70 i 3200 experiments on real and challenging scenes using two different types of Err codemadness.org 70 i 3201 lensless prototypes: one which uses a separable forward model and another, Err codemadness.org 70 i 3202 which uses a more general non-separable cropped-convolution model. Our Err codemadness.org 70 i 3203 end-to-end approach is fast, produces photorealistic reconstructions, and is Err codemadness.org 70 i 3204 easy to adopt for other mask-based lensless cameras. Err codemadness.org 70 i 3205

Err codemadness.org 70 i 3206

Self-awareness in intelligent vehicles: Feature based dynamic Bayesian models for abnormality detection. (arXiv:2010.15441v1 [cs.LG])

The evolution of Intelligent Transportation Systems in recent times Err codemadness.org 70 i 3213 necessitates the development of self-awareness in agents. Before the intensive Err codemadness.org 70 i 3214 use of Machine Learning, the detection of abnormalities was manually programmed Err codemadness.org 70 i 3215 by checking every variable and creating huge nested conditions that are very Err codemadness.org 70 i 3216 difficult to track. This paper aims to introduce a novel method to develop Err codemadness.org 70 i 3217 self-awareness in autonomous vehicles that mainly focuses on detecting abnormal Err codemadness.org 70 i 3218 situations around the considered agents. Multi-sensory time-series data from Err codemadness.org 70 i 3219 the vehicles are used to develop the data-driven Dynamic Bayesian Network (DBN) Err codemadness.org 70 i 3220 models used for future state prediction and the detection of dynamic Err codemadness.org 70 i 3221 abnormalities. Moreover, an initial level collective awareness model that can Err codemadness.org 70 i 3222 perform joint anomaly detection in co-operative tasks is proposed. The GNG Err codemadness.org 70 i 3223 algorithm learns the DBN models' discrete node variables; probabilistic Err codemadness.org 70 i 3224 transition links connect the node variables. A Markov Jump Particle Filter Err codemadness.org 70 i 3225 (MJPF) is applied to predict future states and detect when the vehicle is Err codemadness.org 70 i 3226 potentially misbehaving using learned DBNs as filter parameters. In this paper, Err codemadness.org 70 i 3227 datasets from real experiments of autonomous vehicles performing various tasks Err codemadness.org 70 i 3228 used to learn and test a set of switching DBN models. Err codemadness.org 70 i 3229

Err codemadness.org 70 i 3230

Advanced Python Performance Monitoring with Score-P. (arXiv:2010.15444v1 [cs.DC])

Within the last years, Python became more prominent in the scientific Err codemadness.org 70 i 3237 community and is now used for simulations, machine learning, and data analysis. Err codemadness.org 70 i 3238 All these tasks profit from additional compute power offered by parallelism and Err codemadness.org 70 i 3239 offloading. In the domain of High Performance Computing (HPC), we can look back Err codemadness.org 70 i 3240 to decades of experience exploiting different levels of parallelism on the Err codemadness.org 70 i 3241 core, node or inter-node level, as well as utilising accelerators. By using Err codemadness.org 70 i 3242 performance analysis tools to investigate all these levels of parallelism, we Err codemadness.org 70 i 3243 can tune applications for unprecedented performance. Unfortunately, standard Err codemadness.org 70 i 3244 Python performance analysis tools cannot cope with highly parallel programs. Err codemadness.org 70 i 3245 Since the development of such software is complex and error-prone, we Err codemadness.org 70 i 3246 demonstrate an easy-to-use solution based on an existing tool infrastructure Err codemadness.org 70 i 3247 for performance analysis. In this paper, we describe how to apply the Err codemadness.org 70 i 3248 established instrumentation framework \scorep to trace Python applications. We Err codemadness.org 70 i 3249 finish with a study of the overhead that users can expect for instrumenting Err codemadness.org 70 i 3250 their applications. Err codemadness.org 70 i 3251

Err codemadness.org 70 i 3252

Progressive Voice Trigger Detection: Accuracy vs Latency. (arXiv:2010.15446v1 [eess.AS])

We present an architecture for voice trigger detection for virtual Err codemadness.org 70 i 3259 assistants. The main idea in this work is to exploit information in words that Err codemadness.org 70 i 3260 immediately follow the trigger phrase. We first demonstrate that by including Err codemadness.org 70 i 3261 more audio context after a detected trigger phrase, we can indeed get a more Err codemadness.org 70 i 3262 accurate decision. However, waiting to listen to more audio each time incurs a Err codemadness.org 70 i 3263 latency increase. Progressive Voice Trigger Detection allows us to trade-off Err codemadness.org 70 i 3264 latency and accuracy by accepting clear trigger candidates quickly, but waiting Err codemadness.org 70 i 3265 for more context to decide whether to accept more marginal examples. Using a Err codemadness.org 70 i 3266 two-stage architecture, we show that by delaying the decision for just 3% of Err codemadness.org 70 i 3267 detected true triggers in the test set, we are able to obtain a relative Err codemadness.org 70 i 3268 improvement of 66% in false rejection rate, while incurring only a negligible Err codemadness.org 70 i 3269 increase in latency. Err codemadness.org 70 i 3270

Err codemadness.org 70 i 3271

Capacity-achieving codes: a review on double transitivity. (arXiv:2010.15453v1 [cs.IT])

Recently it was proved that if a linear code is invariant under the action of Err codemadness.org 70 i 3278 a doubly transitive permutation group, it achieves the capacity of erasure Err codemadness.org 70 i 3279 channel. Therefore, it is of sufficient interest to classify all codes, Err codemadness.org 70 i 3280 invariant under such permutation groups. We take a step in this direction and Err codemadness.org 70 i 3281 give a review of all suitable groups and the known results on codes invariant Err codemadness.org 70 i 3282 under these groups. It turns out that there are capacity-achieving families of Err codemadness.org 70 i 3283 algebraic geometric codes. Err codemadness.org 70 i 3284

Err codemadness.org 70 i 3285

Scalable Federated Learning over Passive Optical Networks. (arXiv:2010.15454v1 [cs.NI])

Two-step aggregation is introduced to facilitate scalable federated learning Err codemadness.org 70 i 3292 (SFL) over passive optical networks (PONs). Results reveal that the SFL keeps Err codemadness.org 70 i 3293 the required PON upstream bandwidth constant regardless of the number of Err codemadness.org 70 i 3294 involved clients, while bringing ~10% learning accuracy improvement. Err codemadness.org 70 i 3295

Err codemadness.org 70 i 3296

Optimal Sharing and and Fair Cost Allocation of Community Energy Storage. (arXiv:2010.15455v1 [cs.GT])

This paper studies an ES sharing model where multiple buildings cooperatively Err codemadness.org 70 i 3303 invest and share a community ES (CES) to harness economic benefits from on-site Err codemadness.org 70 i 3304 renewable integration and utility price arbitrage. Particularly, we formulate Err codemadness.org 70 i 3305 the problem that integrates the optimal ES sizing, operation and cost Err codemadness.org 70 i 3306 allocation as a coalition game, which are generally addressed separately in the Err codemadness.org 70 i 3307 literature. Particularly, we address the fair ex-post cost allocation which has Err codemadness.org 70 i 3308 not been well studied. To overcome the computational challenge of computing the Err codemadness.org 70 i 3309 entire information of explicit characteristic functions that takes exponential Err codemadness.org 70 i 3310 time, we propose a fair cost allocation based on nucleolus by employing a Err codemadness.org 70 i 3311 constraints generation technique. We study the fairness and computational Err codemadness.org 70 i 3312 efficiency of the method through a number of case studies. The numeric results Err codemadness.org 70 i 3313 imply that the proposed method outperforms the Shapley approach and Err codemadness.org 70 i 3314 proportional method either in computational efficiency or fairness. Notably, Err codemadness.org 70 i 3315 for the proposed method, only a small fraction of characteristic functions Err codemadness.org 70 i 3316 (2.54%) is computed to achieve the cost allocation versus the entire Err codemadness.org 70 i 3317 information required by Shapley approach. With the proposed cost allocation, we Err codemadness.org 70 i 3318 investigate the enhanced economic benefits of the CES model for individual Err codemadness.org 70 i 3319 buildings over individual ES (IES) installation. We see the CES model provides Err codemadness.org 70 i 3320 higher cost reduction to each committed buildings. Moreover, the value of Err codemadness.org 70 i 3321 storage is obviously improved (about 1.83 times) with the CES model over the Err codemadness.org 70 i 3322 IES model. Err codemadness.org 70 i 3323

Err codemadness.org 70 i 3324

Multilayer Clustered Graph Learning. (arXiv:2010.15456v1 [cs.LG])

Multilayer graphs are appealing mathematical tools for modeling multiple Err codemadness.org 70 i 3331 types of relationship in the data. In this paper, we aim at analyzing Err codemadness.org 70 i 3332 multilayer graphs by properly combining the information provided by individual Err codemadness.org 70 i 3333 layers, while preserving the specific structure that allows us to eventually Err codemadness.org 70 i 3334 identify communities or clusters that are crucial in the analysis of graph Err codemadness.org 70 i 3335 data. To do so, we learn a clustered representative graph by solving an Err codemadness.org 70 i 3336 optimization problem that involves a data fidelity term to the observed layers, Err codemadness.org 70 i 3337 and a regularization pushing for a sparse and community-aware graph. We use the Err codemadness.org 70 i 3338 contrastive loss as a data fidelity term, in order to properly aggregate the Err codemadness.org 70 i 3339 observed layers into a representative graph. The regularization is based on a Err codemadness.org 70 i 3340 measure of graph sparsification called "effective resistance", coupled with a Err codemadness.org 70 i 3341 penalization of the first few eigenvalues of the representative graph Laplacian Err codemadness.org 70 i 3342 matrix to favor the formation of communities. The proposed optimization problem Err codemadness.org 70 i 3343 is nonconvex but fully differentiable, and thus can be solved via the projected Err codemadness.org 70 i 3344 gradient method. Experiments show that our method leads to a significant Err codemadness.org 70 i 3345 improvement w.r.t. state-of-the-art multilayer graph learning algorithms for Err codemadness.org 70 i 3346 solving clustering problems. Err codemadness.org 70 i 3347

Err codemadness.org 70 i 3348

FiGLearn: Filter and Graph Learning using Optimal Transport. (arXiv:2010.15457v1 [cs.LG])

In many applications, a dataset can be considered as a set of observed Err codemadness.org 70 i 3355 signals that live on an unknown underlying graph structure. Some of these Err codemadness.org 70 i 3356 signals may be seen as white noise that has been filtered on the graph topology Err codemadness.org 70 i 3357 by a graph filter. Hence, the knowledge of the filter and the graph provides Err codemadness.org 70 i 3358 valuable information about the underlying data generation process and the Err codemadness.org 70 i 3359 complex interactions that arise in the dataset. We hence introduce a novel Err codemadness.org 70 i 3360 graph signal processing framework for jointly learning the graph and its Err codemadness.org 70 i 3361 generating filter from signal observations. We cast a new optimisation problem Err codemadness.org 70 i 3362 that minimises the Wasserstein distance between the distribution of the signal Err codemadness.org 70 i 3363 observations and the filtered signal distribution model. Our proposed method Err codemadness.org 70 i 3364 outperforms state-of-the-art graph learning frameworks on synthetic data. We Err codemadness.org 70 i 3365 then apply our method to a temperature anomaly dataset, and further show how Err codemadness.org 70 i 3366 this framework can be used to infer missing values if only very little Err codemadness.org 70 i 3367 information is available. Err codemadness.org 70 i 3368

Err codemadness.org 70 i 3369

Named Entity Recognition for Social Media Texts with Semantic Augmentation. (arXiv:2010.15458v1 [cs.CL])

Existing approaches for named entity recognition suffer from data sparsity Err codemadness.org 70 i 3376 problems when conducted on short and informal texts, especially user-generated Err codemadness.org 70 i 3377 social media content. Semantic augmentation is a potential way to alleviate Err codemadness.org 70 i 3378 this problem. Given that rich semantic information is implicitly preserved in Err codemadness.org 70 i 3379 pre-trained word embeddings, they are potential ideal resources for semantic Err codemadness.org 70 i 3380 augmentation. In this paper, we propose a neural-based approach to NER for Err codemadness.org 70 i 3381 social media texts where both local (from running text) and augmented semantics Err codemadness.org 70 i 3382 are taken into account. In particular, we obtain the augmented semantic Err codemadness.org 70 i 3383 information from a large-scale corpus, and propose an attentive semantic Err codemadness.org 70 i 3384 augmentation module and a gate module to encode and aggregate such information, Err codemadness.org 70 i 3385 respectively. Extensive experiments are performed on three benchmark datasets Err codemadness.org 70 i 3386 collected from English and Chinese social media platforms, where the results Err codemadness.org 70 i 3387 demonstrate the superiority of our approach to previous studies across all Err codemadness.org 70 i 3388 three datasets. Err codemadness.org 70 i 3389

Err codemadness.org 70 i 3390

Concatenated Codes for Recovery From Multiple Reads of DNA Sequences. (arXiv:2010.15461v1 [cs.IT])

Decoding sequences that stem from multiple transmissions of a codeword over Err codemadness.org 70 i 3397 an insertion, deletion, and substitution channel is a critical component of Err codemadness.org 70 i 3398 efficient deoxyribonucleic acid (DNA) data storage systems. In this paper, we Err codemadness.org 70 i 3399 consider a concatenated coding scheme with an outer low-density parity-check Err codemadness.org 70 i 3400 code and either an inner convolutional code or a block code. We propose two new Err codemadness.org 70 i 3401 decoding algorithms for inference from multiple received sequences, both Err codemadness.org 70 i 3402 combining the inner code and channel to a joint hidden Markov model to infer Err codemadness.org 70 i 3403 symbolwise a posteriori probabilities (APPs). The first decoder computes the Err codemadness.org 70 i 3404 exact APPs by jointly decoding the received sequences, whereas the second Err codemadness.org 70 i 3405 decoder approximates the APPs by combining the results of separately decoded Err codemadness.org 70 i 3406 received sequences. Using the proposed algorithms, we evaluate the performance Err codemadness.org 70 i 3407 of decoding multiple received sequences by means of achievable information Err codemadness.org 70 i 3408 rates and Monte-Carlo simulations. We show significant performance gains Err codemadness.org 70 i 3409 compared to a single received sequence. Err codemadness.org 70 i 3410

Err codemadness.org 70 i 3411

Self-Supervised Video Representation Using Pretext-Contrastive Learning. (arXiv:2010.15464v1 [cs.CV])

Pretext tasks and contrastive learning have been successful in Err codemadness.org 70 i 3418 self-supervised learning for video retrieval and recognition. In this study, we Err codemadness.org 70 i 3419 analyze their optimization targets and utilize the hyper-sphere feature space Err codemadness.org 70 i 3420 to explore the connections between them, indicating the compatibility and Err codemadness.org 70 i 3421 consistency of these two different learning methods. Based on the analysis, we Err codemadness.org 70 i 3422 propose a self-supervised training method, referred as Pretext-Contrastive Err codemadness.org 70 i 3423 Learning (PCL), to learn video representations. Extensive experiments based on Err codemadness.org 70 i 3424 different combinations of pretext task baselines and contrastive losses confirm Err codemadness.org 70 i 3425 the strong agreement with their self-supervised learning targets, demonstrating Err codemadness.org 70 i 3426 the effectiveness and the generality of PCL. The combination of pretext tasks Err codemadness.org 70 i 3427 and contrastive losses showed significant improvements in both video retrieval Err codemadness.org 70 i 3428 and recognition over the corresponding baselines. And we can also outperform Err codemadness.org 70 i 3429 current state-of-the-art methods in the same manner. Further, our PCL is Err codemadness.org 70 i 3430 flexible and can be applied to almost all existing pretext task methods. Err codemadness.org 70 i 3431

Err codemadness.org 70 i 3432

Improving Named Entity Recognition with Attentive Ensemble of Syntactic Information. (arXiv:2010.15466v1 [cs.CL])

Named entity recognition (NER) is highly sensitive to sentential syntactic Err codemadness.org 70 i 3439 and semantic properties where entities may be extracted according to how they Err codemadness.org 70 i 3440 are used and placed in the running text. To model such properties, one could Err codemadness.org 70 i 3441 rely on existing resources to providing helpful knowledge to the NER task; some Err codemadness.org 70 i 3442 existing studies proved the effectiveness of doing so, and yet are limited in Err codemadness.org 70 i 3443 appropriately leveraging the knowledge such as distinguishing the important Err codemadness.org 70 i 3444 ones for particular context. In this paper, we improve NER by leveraging Err codemadness.org 70 i 3445 different types of syntactic information through attentive ensemble, which Err codemadness.org 70 i 3446 functionalizes by the proposed key-value memory networks, syntax attention, and Err codemadness.org 70 i 3447 the gate mechanism for encoding, weighting and aggregating such syntactic Err codemadness.org 70 i 3448 information, respectively. Experimental results on six English and Chinese Err codemadness.org 70 i 3449 benchmark datasets suggest the effectiveness of the proposed model and show Err codemadness.org 70 i 3450 that it outperforms previous studies on all experiment datasets. Err codemadness.org 70 i 3451

Err codemadness.org 70 i 3452

Emergence of Spatial Coordinates via Exploration. (arXiv:2010.15469v1 [cs.LG])

Spatial knowledge is a fundamental building block for the development of Err codemadness.org 70 i 3459 advanced perceptive and cognitive abilities. Traditionally, in robotics, the Err codemadness.org 70 i 3460 Euclidean (x,y,z) coordinate system and the agent's forward model are defined a Err codemadness.org 70 i 3461 priori. We show that a naive agent can autonomously build an internal Err codemadness.org 70 i 3462 coordinate system, with the same dimension and metric regularity as the Err codemadness.org 70 i 3463 external space, simply by learning to predict the outcome of sensorimotor Err codemadness.org 70 i 3464 transitions in a self-supervised way. Err codemadness.org 70 i 3465

Err codemadness.org 70 i 3466

Hybrid mimetic finite-difference and virtual element formulation for coupled poromechanics. (arXiv:2010.15470v1 [math.NA])

We present a hybrid mimetic finite-difference and virtual element formulation Err codemadness.org 70 i 3473 for coupled single-phase poromechanics on unstructured meshes. The key Err codemadness.org 70 i 3474 advantage of the scheme is that it is convergent on complex meshes containing Err codemadness.org 70 i 3475 highly distorted cells with arbitrary shapes. We use a local pressure-jump Err codemadness.org 70 i 3476 stabilization method based on unstructured macro-elements to prevent the Err codemadness.org 70 i 3477 development of spurious pressure modes in incompressible problems approaching Err codemadness.org 70 i 3478 undrained conditions. A scalable linear solution strategy is obtained using a Err codemadness.org 70 i 3479 block-triangular preconditioner designed specifically for the saddle-point Err codemadness.org 70 i 3480 systems arising from the proposed discretization. The accuracy and efficiency Err codemadness.org 70 i 3481 of our approach are demonstrated numerically on two-dimensional benchmark Err codemadness.org 70 i 3482 problems. Err codemadness.org 70 i 3483

Err codemadness.org 70 i 3484

Iteratively reweighted greedy set cover. (arXiv:2010.15476v1 [cs.DS])

We empirically analyze a simple heuristic for large sparse set cover Err codemadness.org 70 i 3491 problems. It uses the weighted greedy algorithm as a basic building block. By Err codemadness.org 70 i 3492 multiplicative updates of the weights attached to the elements, the greedy Err codemadness.org 70 i 3493 solution is iteratively improved. The implementation of this algorithm is Err codemadness.org 70 i 3494 trivial and the algorithm is essentially free of parameters that would require Err codemadness.org 70 i 3495 tuning. More iterations can only improve the solution. This set of features Err codemadness.org 70 i 3496 makes the approach attractive for practical problems. Err codemadness.org 70 i 3497

Err codemadness.org 70 i 3498

Learned infinite elements. (arXiv:2010.15479v1 [math.NA])

We study the numerical solution of scalar time-harmonic wave equations on Err codemadness.org 70 i 3505 unbounded domains which can be split into a bounded interior domain of primary Err codemadness.org 70 i 3506 interest and an exterior domain with separable geometry. To compute the Err codemadness.org 70 i 3507 solution in the interior domain, approximations to the Dirichlet-to-Neumann Err codemadness.org 70 i 3508 (DtN) map of the exterior domain have to be imposed as transparent boundary Err codemadness.org 70 i 3509 conditions on the artificial coupling boundary. Although the DtN map can be Err codemadness.org 70 i 3510 computed by separation of variables, it is a nonlocal operator with dense Err codemadness.org 70 i 3511 matrix representations, and hence computationally inefficient. Therefore, Err codemadness.org 70 i 3512 approximations of DtN maps by sparse matrices, usually involving additional Err codemadness.org 70 i 3513 degrees of freedom, have been studied intensively in the literature using a Err codemadness.org 70 i 3514 variety of approaches including different types of infinite elements, local Err codemadness.org 70 i 3515 non-reflecting boundary conditions, and perfectly matched layers. The entries Err codemadness.org 70 i 3516 of these sparse matrices are derived analytically, e.g. from transformations or Err codemadness.org 70 i 3517 asymptotic expansions of solutions to the differential equation in the exterior Err codemadness.org 70 i 3518 domain. In contrast, in this paper we propose to `learn' the matrix entries Err codemadness.org 70 i 3519 from the DtN map in its separated form by solving an optimization problem as a Err codemadness.org 70 i 3520 preprocessing step. Theoretical considerations suggest that the approximation Err codemadness.org 70 i 3521 quality of learned infinite elements improves exponentially with increasing Err codemadness.org 70 i 3522 number of infinite element degrees of freedom, which is confirmed in numerical Err codemadness.org 70 i 3523 experiments. These numerical studies also show that learned infinite elements Err codemadness.org 70 i 3524 outperform state-of-the-art methods for the Helmholtz equation. At the same Err codemadness.org 70 i 3525 time, learned infinite elements are much more flexible than traditional methods Err codemadness.org 70 i 3526 as they, e.g., work similarly well for exterior domains involving strong Err codemadness.org 70 i 3527 reflections, for example, for the atmosphere of the Sun, which is strongly Err codemadness.org 70 i 3528 inhomogeneous and exhibits reflections at the corona. Err codemadness.org 70 i 3529

Err codemadness.org 70 i 3530

Convergence of Constrained Anderson Acceleration. (arXiv:2010.15482v1 [math.NA])

We prove non asymptotic linear convergence rates for the constrained Anderson Err codemadness.org 70 i 3537 acceleration extrapolation scheme. These guarantees come from new upper bounds Err codemadness.org 70 i 3538 on the constrained Chebyshev problem, which consists in minimizing the maximum Err codemadness.org 70 i 3539 absolute value of a polynomial on a bounded real interval with $l_1$ Err codemadness.org 70 i 3540 constraints on its coefficients vector. Constrained Anderson Acceleration has a Err codemadness.org 70 i 3541 numerical cost comparable to that of the original scheme. Err codemadness.org 70 i 3542

Err codemadness.org 70 i 3543

Beyond cross-entropy: learning highly separable feature distributions for robust and accurate classification. (arXiv:2010.15487v1 [cs.CV])

Deep learning has shown outstanding performance in several applications Err codemadness.org 70 i 3550 including image classification. However, deep classifiers are known to be Err codemadness.org 70 i 3551 highly vulnerable to adversarial attacks, in that a minor perturbation of the Err codemadness.org 70 i 3552 input can easily lead to an error. Providing robustness to adversarial attacks Err codemadness.org 70 i 3553 is a very challenging task especially in problems involving a large number of Err codemadness.org 70 i 3554 classes, as it typically comes at the expense of an accuracy decrease. In this Err codemadness.org 70 i 3555 work, we propose the Gaussian class-conditional simplex (GCCS) loss: a novel Err codemadness.org 70 i 3556 approach for training deep robust multiclass classifiers that provides Err codemadness.org 70 i 3557 adversarial robustness while at the same time achieving or even surpassing the Err codemadness.org 70 i 3558 classification accuracy of state-of-the-art methods. Differently from other Err codemadness.org 70 i 3559 frameworks, the proposed method learns a mapping of the input classes onto Err codemadness.org 70 i 3560 target distributions in a latent space such that the classes are linearly Err codemadness.org 70 i 3561 separable. Instead of maximizing the likelihood of target labels for individual Err codemadness.org 70 i 3562 samples, our objective function pushes the network to produce feature Err codemadness.org 70 i 3563 distributions yielding high inter-class separation. The mean values of the Err codemadness.org 70 i 3564 distributions are centered on the vertices of a simplex such that each class is Err codemadness.org 70 i 3565 at the same distance from every other class. We show that the regularization of Err codemadness.org 70 i 3566 the latent space based on our approach yields excellent classification accuracy Err codemadness.org 70 i 3567 and inherently provides robustness to multiple adversarial attacks, both Err codemadness.org 70 i 3568 targeted and untargeted, outperforming state-of-the-art approaches over Err codemadness.org 70 i 3569 challenging datasets. Err codemadness.org 70 i 3570

Err codemadness.org 70 i 3571

Linearizing Combinators. (arXiv:2010.15490v1 [math.CT])

In 2017, Bauer, Johnson, Osborne, Riehl, and Tebbe (BJORT) showed that the Err codemadness.org 70 i 3578 Abelian functor calculus provides an example of a Cartesian differential Err codemadness.org 70 i 3579 category. The definition of a Cartesian differential category is based on a Err codemadness.org 70 i 3580 differential combinator which directly formalizes the total derivative from Err codemadness.org 70 i 3581 multivariable calculus. However, in the aforementioned work the authors used Err codemadness.org 70 i 3582 techniques from Goodwillie's functor calculus to establish a linearization Err codemadness.org 70 i 3583 process from which they then derived a differential combinator. This raised the Err codemadness.org 70 i 3584 question of what the precise relationship between linearization and having a Err codemadness.org 70 i 3585 differential combinator might be. Err codemadness.org 70 i 3586

Err codemadness.org 70 i 3587

In this paper, we introduce the notion of a linearizing combinator which Err codemadness.org 70 i 3588 abstracts linearization in the Abelian functor calculus. We then use it to Err codemadness.org 70 i 3589 provide an alternative axiomatization of a Cartesian differential category. Err codemadness.org 70 i 3590 Every Cartesian differential category comes equipped with a canonical Err codemadness.org 70 i 3591 linearizing combinator obtained by differentiation at zero. Conversely, a Err codemadness.org 70 i 3592 differential combinator can be constructed \`a la BJORT when one has a system Err codemadness.org 70 i 3593 of partial linearizing combinators in each context. Thus, while linearizing Err codemadness.org 70 i 3594 combinators do provide an alternative axiomatization of Cartesian differential Err codemadness.org 70 i 3595 categories, an explicit notion of partial linearization is required. This is in Err codemadness.org 70 i 3596 contrast to the situation for differential combinators where partial Err codemadness.org 70 i 3597 differentiation is automatic in the presence of total differentiation. The Err codemadness.org 70 i 3598 ability to form a system of partial linearizing combinators from a total Err codemadness.org 70 i 3599 linearizing combinator, while not being possible in general, is possible when Err codemadness.org 70 i 3600 the setting is Cartesian closed. Err codemadness.org 70 i 3601

Err codemadness.org 70 i 3602

A Novel Fast 3D Single Image Super-Resolution Algorithm. (arXiv:2010.15491v1 [eess.IV])

This paper introduces a novel computationally efficient method of solving the Err codemadness.org 70 i 3609 3D single image super-resolution (SR) problem, i.e., reconstruction of a Err codemadness.org 70 i 3610 high-resolution volume from its low-resolution counterpart. The main Err codemadness.org 70 i 3611 contribution lies in the original way of handling simultaneously the associated Err codemadness.org 70 i 3612 decimation and blurring operators, based on their underlying properties in the Err codemadness.org 70 i 3613 frequency domain. In particular, the proposed decomposition technique of the 3D Err codemadness.org 70 i 3614 decimation operator allows a straightforward implementation for Tikhonov Err codemadness.org 70 i 3615 regularization, and can be further used to take into consideration other Err codemadness.org 70 i 3616 regularization functions such as the total variation, enabling the Err codemadness.org 70 i 3617 computational cost of state-of-the-art algorithms to be considerably decreased. Err codemadness.org 70 i 3618 Numerical experiments carried out showed that the proposed approach outperforms Err codemadness.org 70 i 3619 existing 3D SR methods. Err codemadness.org 70 i 3620

Err codemadness.org 70 i 3621

"What, not how" -- Solving an under-actuated insertion task from scratch. (arXiv:2010.15492v1 [cs.RO])

Robot manipulation requires a complex set of skills that need to be carefully Err codemadness.org 70 i 3628 combined and coordinated to solve a task. Yet, most ReinforcementLearning (RL) Err codemadness.org 70 i 3629 approaches in robotics study tasks which actually consist only of a single Err codemadness.org 70 i 3630 manipulation skill, such as grasping an object or inserting a pre-grasped Err codemadness.org 70 i 3631 object. As a result the skill ('how' to solve the task) but not the actual goal Err codemadness.org 70 i 3632 of a complete manipulation ('what' to solve) is specified. In contrast, we Err codemadness.org 70 i 3633 study a complex manipulation goal that requires an agent to learn and combine Err codemadness.org 70 i 3634 diverse manipulation skills. We propose a challenging, highly under-actuated Err codemadness.org 70 i 3635 peg-in-hole task with a free, rotational asymmetrical peg, requiring a broad Err codemadness.org 70 i 3636 range of manipulation skills. While correct peg (re-)orientation is a Err codemadness.org 70 i 3637 requirement for successful insertion, there is no reward associated with it. Err codemadness.org 70 i 3638 Hence an agent needs to understand this pre-condition and learn the skill to Err codemadness.org 70 i 3639 fulfil it. The final insertion reward is sparse, allowing freedom in the Err codemadness.org 70 i 3640 solution and leading to complex emerging behaviour not envisioned during the Err codemadness.org 70 i 3641 task design. We tackle the problem in a multi-task RL framework using Scheduled Err codemadness.org 70 i 3642 Auxiliary Control (SAC-X) combined with Regularized Hierarchical Policy Err codemadness.org 70 i 3643 Optimization (RHPO) which successfully solves the task in simulation and from Err codemadness.org 70 i 3644 scratch on a single robot where data is severely limited. Err codemadness.org 70 i 3645

Err codemadness.org 70 i 3646

Enhancing Vulnerable Road User Safety: A Survey of Existing Practices and Consideration for Using Mobile Devices for V2X Connections. (arXiv:2010.15502v1 [cs.NI])

Vulnerable road users (VRUs) such as pedestrians, cyclists and motorcyclists Err codemadness.org 70 i 3653 are at the highest risk in the road traffic environment. Globally, over half of Err codemadness.org 70 i 3654 road traffic deaths are vulnerable road users. Although substantial efforts are Err codemadness.org 70 i 3655 being made to improve VRU safety from engineering solutions to law enforcement, Err codemadness.org 70 i 3656 the death toll of VRUs' continues to rise. The emerging technology, Cooperative Err codemadness.org 70 i 3657 Intelligent Transportation System (C-ITS), has the proven potential to enhance Err codemadness.org 70 i 3658 road safety by enabling wireless communication to exchange information among Err codemadness.org 70 i 3659 road users. Such exchanged information is utilized for creating situational Err codemadness.org 70 i 3660 awareness and detecting any potential collisions in advance to take necessary Err codemadness.org 70 i 3661 measures to avoid any possible road casualties. The current state-of-the-art Err codemadness.org 70 i 3662 solutions of C-ITS for VRU safety, however, are limited to unidirectional Err codemadness.org 70 i 3663 communication where VRUs are only responsible for alerting their presence to Err codemadness.org 70 i 3664 drivers with the intention of avoiding collisions. This one-way interaction is Err codemadness.org 70 i 3665 substantially limiting the enormous potential of C-ITS which otherwise can be Err codemadness.org 70 i 3666 employed to devise a more effective solution for the VRU safety where VRU can Err codemadness.org 70 i 3667 be equipped with bidirectional communication with full C-ITS functionalities. Err codemadness.org 70 i 3668 To address such problems and to explore better C-ITS solution suggestions for Err codemadness.org 70 i 3669 VRU, this paper reviewed and evaluated the current technologies and safety Err codemadness.org 70 i 3670 methods proposed for VRU safety over the period 2007-2020. Later, it presents Err codemadness.org 70 i 3671 the design considerations for a cellular-based Vehicle-to-VRU (V2VRU) Err codemadness.org 70 i 3672 communication system along with potential challenges of a cellular-based Err codemadness.org 70 i 3673 approach to provide necessary recommendations. Err codemadness.org 70 i 3674

Err codemadness.org 70 i 3675

A stochastic $\theta$-SEIHRD model: adding randomness to the COVID-19 spread. (arXiv:2010.15504v1 [math.NA])

In this article we mainly extend the deterministic model developed in [10] to Err codemadness.org 70 i 3682 a stochastic setting. More precisely, we incorporated randomness in some Err codemadness.org 70 i 3683 coefficients by assuming that they follow a prescribed stochastic dynamics. In Err codemadness.org 70 i 3684 this way, the model variables are now represented by stochastic process, that Err codemadness.org 70 i 3685 can be simulated by appropriately solve the system of stochastic differential Err codemadness.org 70 i 3686 equations. Thus, the model becomes more complete and flexible than the Err codemadness.org 70 i 3687 deterministic analogous, as it incorporates additional uncertainties which are Err codemadness.org 70 i 3688 present in more realistic situations. In particular, confidence intervals for Err codemadness.org 70 i 3689 the main variables and worst case scenarios can be computed. Err codemadness.org 70 i 3690

Err codemadness.org 70 i 3691

Dynamic Formation Reshaping Based on Point Set Registration in a Swarm of Drones. (arXiv:2010.15506v1 [cs.RO])

This work focuses on the formation reshaping in an optimized manner in Err codemadness.org 70 i 3698 autonomous swarm of drones. Here, the two main problems are: 1) how to break Err codemadness.org 70 i 3699 and reshape the initial formation in an optimal manner, and 2) how to do such Err codemadness.org 70 i 3700 reformation while minimizing the overall deviation of the drones and the Err codemadness.org 70 i 3701 overall time, i.e., without slowing down. To address the first problem, we Err codemadness.org 70 i 3702 introduce a set of routines for the drones/agents to follow while reshaping to Err codemadness.org 70 i 3703 a secondary formation shape. And the second problem is resolved by utilizing Err codemadness.org 70 i 3704 the temperature function reduction technique, originally used in the point set Err codemadness.org 70 i 3705 registration process. The goal is to be able to dynamically reform the shape of Err codemadness.org 70 i 3706 multi-agent based swarm in near-optimal manner while going through narrow Err codemadness.org 70 i 3707 openings between, for instance obstacles, and then bringing the agents back to Err codemadness.org 70 i 3708 their original shape after passing through the narrow passage using point set Err codemadness.org 70 i 3709 registration technique. Err codemadness.org 70 i 3710

Err codemadness.org 70 i 3711

Dynamic Resource-aware Corner Detection for Bio-inspired Vision Sensors. (arXiv:2010.15507v1 [cs.CV])

Event-based cameras are vision devices that transmit only brightness changes Err codemadness.org 70 i 3718 with low latency and ultra-low power consumption. Such characteristics make Err codemadness.org 70 i 3719 event-based cameras attractive in the field of localization and object tracking Err codemadness.org 70 i 3720 in resource-constrained systems. Since the number of generated events in such Err codemadness.org 70 i 3721 cameras is huge, the selection and filtering of the incoming events are Err codemadness.org 70 i 3722 beneficial from both increasing the accuracy of the features and reducing the Err codemadness.org 70 i 3723 computational load. In this paper, we present an algorithm to detect Err codemadness.org 70 i 3724 asynchronous corners from a stream of events in real-time on embedded systems. Err codemadness.org 70 i 3725 The algorithm is called the Three Layer Filtering-Harris or TLF-Harris Err codemadness.org 70 i 3726 algorithm. The algorithm is based on an events' filtering strategy whose Err codemadness.org 70 i 3727 purpose is 1) to increase the accuracy by deliberately eliminating some Err codemadness.org 70 i 3728 incoming events, i.e., noise, and 2) to improve the real-time performance of Err codemadness.org 70 i 3729 the system, i.e., preserving a constant throughput in terms of input events per Err codemadness.org 70 i 3730 second, by discarding unnecessary events with a limited accuracy loss. An Err codemadness.org 70 i 3731 approximation of the Harris algorithm, in turn, is used to exploit its Err codemadness.org 70 i 3732 high-quality detection capability with a low-complexity implementation to Err codemadness.org 70 i 3733 enable seamless real-time performance on embedded computing platforms. The Err codemadness.org 70 i 3734 proposed algorithm is capable of selecting the best corner candidate among Err codemadness.org 70 i 3735 neighbors and achieves an average execution time savings of 59 % compared with Err codemadness.org 70 i 3736 the conventional Harris score. Moreover, our approach outperforms the competing Err codemadness.org 70 i 3737 methods, such as eFAST, eHarris, and FA-Harris, in terms of real-time Err codemadness.org 70 i 3738 performance, and surpasses Arc* in terms of accuracy. Err codemadness.org 70 i 3739

Err codemadness.org 70 i 3740

FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement. (arXiv:2010.15508v1 [eess.AS])

This paper proposes a full-band and sub-band fusion model, named as Err codemadness.org 70 i 3747 FullSubNet, for single-channel real-time speech enhancement. Full-band and Err codemadness.org 70 i 3748 sub-band refer to the models that input full-band and sub-band noisy spectral Err codemadness.org 70 i 3749 feature, output full-band and sub-band speech target, respectively. The Err codemadness.org 70 i 3750 sub-band model processes each frequency independently. Its input consists of Err codemadness.org 70 i 3751 one frequency and several context frequencies. The output is the prediction of Err codemadness.org 70 i 3752 the clean speech target for the corresponding frequency. These two types of Err codemadness.org 70 i 3753 models have distinct characteristics. The full-band model can capture the Err codemadness.org 70 i 3754 global spectral context and the long-distance cross-band dependencies. However, Err codemadness.org 70 i 3755 it lacks the ability to modeling signal stationarity and attending the local Err codemadness.org 70 i 3756 spectral pattern. The sub-band model is just the opposite. In our proposed Err codemadness.org 70 i 3757 FullSubNet, we connect a pure full-band model and a pure sub-band model Err codemadness.org 70 i 3758 sequentially and use practical joint training to integrate these two types of Err codemadness.org 70 i 3759 models' advantages. We conducted experiments on the DNS challenge (INTERSPEECH Err codemadness.org 70 i 3760 2020) dataset to evaluate the proposed method. Experimental results show that Err codemadness.org 70 i 3761 full-band and sub-band information are complementary, and the FullSubNet can Err codemadness.org 70 i 3762 effectively integrate them. Besides, the performance of the FullSubNet also Err codemadness.org 70 i 3763 exceeds that of the top-ranked methods in the DNS Challenge (INTERSPEECH 2020). Err codemadness.org 70 i 3764

Err codemadness.org 70 i 3765

Night vision obstacle detection and avoidance based on Bio-Inspired Vision Sensors. (arXiv:2010.15509v1 [cs.CV])

Moving towards autonomy, unmanned vehicles rely heavily on state-of-the-art Err codemadness.org 70 i 3772 collision avoidance systems (CAS). However, the detection of obstacles Err codemadness.org 70 i 3773 especially during night-time is still a challenging task since the lighting Err codemadness.org 70 i 3774 conditions are not sufficient for traditional cameras to function properly. Err codemadness.org 70 i 3775 Therefore, we exploit the powerful attributes of event-based cameras to perform Err codemadness.org 70 i 3776 obstacle detection in low lighting conditions. Event cameras trigger events Err codemadness.org 70 i 3777 asynchronously at high output temporal rate with high dynamic range of up to Err codemadness.org 70 i 3778 120 $dB$. The algorithm filters background activity noise and extracts objects Err codemadness.org 70 i 3779 using robust Hough transform technique. The depth of each detected object is Err codemadness.org 70 i 3780 computed by triangulating 2D features extracted utilising LC-Harris. Finally, Err codemadness.org 70 i 3781 asynchronous adaptive collision avoidance (AACA) algorithm is applied for Err codemadness.org 70 i 3782 effective avoidance. Qualitative evaluation is compared using event-camera and Err codemadness.org 70 i 3783 traditional camera. Err codemadness.org 70 i 3784

Err codemadness.org 70 i 3785

Asynchronous Corner Tracking Algorithm based on Lifetime of Events for DAVIS Cameras. (arXiv:2010.15510v1 [cs.CV])

Event cameras, i.e., the Dynamic and Active-pixel Vision Sensor (DAVIS) ones, Err codemadness.org 70 i 3792 capture the intensity changes in the scene and generates a stream of events in Err codemadness.org 70 i 3793 an asynchronous fashion. The output rate of such cameras can reach up to 10 Err codemadness.org 70 i 3794 million events per second in high dynamic environments. DAVIS cameras use novel Err codemadness.org 70 i 3795 vision sensors that mimic human eyes. Their attractive attributes, such as high Err codemadness.org 70 i 3796 output rate, High Dynamic Range (HDR), and high pixel bandwidth, make them an Err codemadness.org 70 i 3797 ideal solution for applications that require high-frequency tracking. Moreover, Err codemadness.org 70 i 3798 applications that operate in challenging lighting scenarios can exploit the Err codemadness.org 70 i 3799 high HDR of event cameras, i.e., 140 dB compared to 60 dB of traditional Err codemadness.org 70 i 3800 cameras. In this paper, a novel asynchronous corner tracking method is proposed Err codemadness.org 70 i 3801 that uses both events and intensity images captured by a DAVIS camera. The Err codemadness.org 70 i 3802 Harris algorithm is used to extract features, i.e., frame-corners from Err codemadness.org 70 i 3803 keyframes, i.e., intensity images. Afterward, a matching algorithm is used to Err codemadness.org 70 i 3804 extract event-corners from the stream of events. Events are solely used to Err codemadness.org 70 i 3805 perform asynchronous tracking until the next keyframe is captured. Neighboring Err codemadness.org 70 i 3806 events, within a window size of 5x5 pixels around the event-corner, are used to Err codemadness.org 70 i 3807 calculate the velocity and direction of extracted event-corners by fitting the Err codemadness.org 70 i 3808 2D planar using a randomized Hough transform algorithm. Experimental evaluation Err codemadness.org 70 i 3809 showed that our approach is able to update the location of the extracted Err codemadness.org 70 i 3810 corners up to 100 times during the blind time of traditional cameras, i.e., Err codemadness.org 70 i 3811 between two consecutive intensity images. Err codemadness.org 70 i 3812

Err codemadness.org 70 i 3813

An Exact Solution Path Algorithm for SLOPE and Quasi-Spherical OSCAR. (arXiv:2010.15511v1 [stat.ME])

Sorted $L_1$ penalization estimator (SLOPE) is a regularization technique for Err codemadness.org 70 i 3820 sorted absolute coefficients in high-dimensional regression. By arbitrarily Err codemadness.org 70 i 3821 setting its regularization weights $\lambda$ under the monotonicity constraint, Err codemadness.org 70 i 3822 SLOPE can have various feature selection and clustering properties. On weight Err codemadness.org 70 i 3823 tuning, the selected features and their clusters are very sensitive to the Err codemadness.org 70 i 3824 tuning parameters. Moreover, the exhaustive tracking of their changes is Err codemadness.org 70 i 3825 difficult using grid search methods. This study presents a solution path Err codemadness.org 70 i 3826 algorithm that provides the complete and exact path of solutions for SLOPE in Err codemadness.org 70 i 3827 fine-tuning regularization weights. A simple optimality condition for SLOPE is Err codemadness.org 70 i 3828 derived and used to specify the next splitting point of the solution path. This Err codemadness.org 70 i 3829 study also proposes a new design of a regularization sequence $\lambda$ for Err codemadness.org 70 i 3830 feature clustering, which is called the quasi-spherical and octagonal shrinkage Err codemadness.org 70 i 3831 and clustering algorithm for regression (QS-OSCAR). QS-OSCAR is designed with a Err codemadness.org 70 i 3832 contour surface of the regularization terms most similar to a sphere. Among Err codemadness.org 70 i 3833 several regularization sequence designs, sparsity and clustering performance Err codemadness.org 70 i 3834 are compared through simulation studies. The numerical observations show that Err codemadness.org 70 i 3835 QS-OSCAR performs feature clustering more efficiently than other designs. Err codemadness.org 70 i 3836

Err codemadness.org 70 i 3837

UNetGAN: A Robust Speech Enhancement Approach in Time Domain for Extremely Low Signal-to-noise Ratio Condition. (arXiv:2010.15521v1 [eess.AS])

Speech enhancement at extremely low signal-to-noise ratio (SNR) condition is Err codemadness.org 70 i 3844 a very challenging problem and rarely investigated in previous works. This Err codemadness.org 70 i 3845 paper proposes a robust speech enhancement approach (UNetGAN) based on U-Net Err codemadness.org 70 i 3846 and generative adversarial learning to deal with this problem. This approach Err codemadness.org 70 i 3847 consists of a generator network and a discriminator network, which operate Err codemadness.org 70 i 3848 directly in the time domain. The generator network adopts a U-Net like Err codemadness.org 70 i 3849 structure and employs dilated convolution in the bottleneck of it. We evaluate Err codemadness.org 70 i 3850 the performance of the UNetGAN at low SNR conditions (up to -20dB) on the Err codemadness.org 70 i 3851 public benchmark. The result demonstrates that it significantly improves the Err codemadness.org 70 i 3852 speech quality and substantially outperforms the representative deep learning Err codemadness.org 70 i 3853 models, including SEGAN, cGAN fo SE, Bidirectional LSTM using phase-sensitive Err codemadness.org 70 i 3854 spectrum approximation cost function (PSA-BLSTM) and Wave-U-Net regarding Err codemadness.org 70 i 3855 Short-Time Objective Intelligibility (STOI) and Perceptual evaluation of speech Err codemadness.org 70 i 3856 quality (PESQ). Err codemadness.org 70 i 3857

Err codemadness.org 70 i 3858

A brief overview of swarm intelligence-based algorithms for numerical association rule mining. (arXiv:2010.15524v1 [cs.NE])

Numerical Association Rule Mining is a popular variant of Association Rule Err codemadness.org 70 i 3865 Mining, where numerical attributes are handled without discretization. This Err codemadness.org 70 i 3866 means that the algorithms for dealing with this problem can operate directly, Err codemadness.org 70 i 3867 not only with categorical, but also with numerical attributes. Until recently, Err codemadness.org 70 i 3868 a big portion of these algorithms were based on a stochastic nature-inspired Err codemadness.org 70 i 3869 population-based paradigm. As a result, evolutionary and swarm Err codemadness.org 70 i 3870 intelligence-based algorithms showed big efficiency for dealing with the Err codemadness.org 70 i 3871 problem. In line with this, the main mission of this chapter is to make a Err codemadness.org 70 i 3872 historical overview of swarm intelligence-based algorithms for Numerical Err codemadness.org 70 i 3873 Association Rule Mining, as well as to present the main features of these Err codemadness.org 70 i 3874 algorithms for the observed problem. A taxonomy of the algorithms was proposed Err codemadness.org 70 i 3875 on the basis of the applied features found in this overview. Challenges, Err codemadness.org 70 i 3876 waiting in the future, finish this paper. Err codemadness.org 70 i 3877

Err codemadness.org 70 i 3878

Self-Learning Threshold-Based Load Balancing. (arXiv:2010.15525v1 [cs.PF])

We consider a large-scale service system where incoming tasks have to be Err codemadness.org 70 i 3885 instantaneously dispatched to one out of many parallel server pools. The Err codemadness.org 70 i 3886 dispatcher uses a threshold for balancing the load and keeping the maximum Err codemadness.org 70 i 3887 number of concurrent tasks across server pools low. We demonstrate that such a Err codemadness.org 70 i 3888 policy is optimal on the fluid and diffusion scales for a suitable threshold Err codemadness.org 70 i 3889 value, while only involving a small communication overhead. In order to set the Err codemadness.org 70 i 3890 threshold optimally, it is important, however, to learn the load of the system, Err codemadness.org 70 i 3891 which may be uncertain or even time-varying. For that purpose, we design a Err codemadness.org 70 i 3892 control rule for tuning the threshold in an online manner. We provide Err codemadness.org 70 i 3893 conditions which guarantee that this adaptive threshold settles at the optimal Err codemadness.org 70 i 3894 value, along with estimates for the time until this happens. Err codemadness.org 70 i 3895

Err codemadness.org 70 i 3896

A comparison of automatic multi-tissue segmentation methods of the human fetal brain using the FeTA Dataset. (arXiv:2010.15526v1 [eess.IV])

It is critical to quantitatively analyse the developing human fetal brain in Err codemadness.org 70 i 3903 order to fully understand neurodevelopment in both normal fetuses and those Err codemadness.org 70 i 3904 with congenital disorders. To facilitate this analysis, automatic multi-tissue Err codemadness.org 70 i 3905 fetal brain segmentation algorithms are needed, which in turn requires open Err codemadness.org 70 i 3906 databases of segmented fetal brains. Here we introduce a publicly available Err codemadness.org 70 i 3907 database of 50 manually segmented pathological and non-pathological fetal Err codemadness.org 70 i 3908 magnetic resonance brain volume reconstructions across a range of gestational Err codemadness.org 70 i 3909 ages (20 to 33 weeks) into 7 different tissue categories (external Err codemadness.org 70 i 3910 cerebrospinal fluid, grey matter, white matter, ventricles, cerebellum, deep Err codemadness.org 70 i 3911 grey matter, brainstem/spinal cord). In addition, we quantitatively evaluate Err codemadness.org 70 i 3912 the accuracy of several automatic multi-tissue segmentation algorithms of the Err codemadness.org 70 i 3913 developing human fetal brain. Four research groups participated, submitting a Err codemadness.org 70 i 3914 total of 10 algorithms, demonstrating the benefits the database for the Err codemadness.org 70 i 3915 development of automatic algorithms. Err codemadness.org 70 i 3916

Err codemadness.org 70 i 3917

On the robustness of kernel-based pairwise learning. (arXiv:2010.15527v1 [stat.ML])

It is shown that many results on the statistical robustness of kernel-based Err codemadness.org 70 i 3924 pairwise learning can be derived under basically no assumptions on the input Err codemadness.org 70 i 3925 and output spaces. In particular neither moment conditions on the conditional Err codemadness.org 70 i 3926 distribution of Y given X = x nor the boundedness of the output space is Err codemadness.org 70 i 3927 needed. We obtain results on the existence and boundedness of the influence Err codemadness.org 70 i 3928 function and show qualitative robustness of the kernel-based estimator. The Err codemadness.org 70 i 3929 present paper generalizes results by Christmann and Zhou (2016) by allowing the Err codemadness.org 70 i 3930 prediction function to take two arguments and can thus be applied in a variety Err codemadness.org 70 i 3931 of situations such as ranking. Err codemadness.org 70 i 3932

Err codemadness.org 70 i 3933

An End to End Network Architecture for Fundamental Matrix Estimation. (arXiv:2010.15528v1 [cs.CV])

In this paper, we present a novel end-to-end network architecture to estimate Err codemadness.org 70 i 3940 fundamental matrix directly from stereo images. To establish a complete working Err codemadness.org 70 i 3941 pipeline, different deep neural networks in charge of finding correspondences Err codemadness.org 70 i 3942 in images, performing outlier rejection and calculating fundamental matrix, are Err codemadness.org 70 i 3943 integrated into an end-to-end network architecture. Err codemadness.org 70 i 3944

Err codemadness.org 70 i 3945

To well train the network and preserve geometry properties of fundamental Err codemadness.org 70 i 3946 matrix, a new loss function is introduced. To evaluate the accuracy of Err codemadness.org 70 i 3947 estimated fundamental matrix more reasonably, we design a new evaluation metric Err codemadness.org 70 i 3948 which is highly consistent with visualization result. Experiments conducted on Err codemadness.org 70 i 3949 both outdoor and indoor data-sets show that this network outperforms Err codemadness.org 70 i 3950 traditional methods as well as previous deep learning based methods on various Err codemadness.org 70 i 3951 metrics and achieves significant performance improvements. Err codemadness.org 70 i 3952

Err codemadness.org 70 i 3953

Probabilistic interval predictor based on dissimilarity functions. (arXiv:2010.15530v1 [eess.SY])

This work presents a new method to obtain probabilistic interval predictions Err codemadness.org 70 i 3960 of a dynamical system. The method uses stored past system measurements to Err codemadness.org 70 i 3961 estimate the future evolution of the system. The proposed method relies on the Err codemadness.org 70 i 3962 use of dissimilarity functions to estimate the conditional probability density Err codemadness.org 70 i 3963 function of the outputs. A family of empirical probability density functions, Err codemadness.org 70 i 3964 parameterized by means of two parameters, is introduced. It is shown that the Err codemadness.org 70 i 3965 the proposed family encompasses the multivariable normal probability density Err codemadness.org 70 i 3966 function as a particular case. We show that the proposed method constitutes a Err codemadness.org 70 i 3967 generalization of classical estimation methods. A cross-validation scheme is Err codemadness.org 70 i 3968 used to tune the two parameters on which the methodology relies. In order to Err codemadness.org 70 i 3969 prove the effectiveness of the methodology presented, some numerical examples Err codemadness.org 70 i 3970 and comparisons are provided. Err codemadness.org 70 i 3971

Err codemadness.org 70 i 3972

Coordinated Formation Control for Intelligent and Connected Vehicles in Multiple Traffic Scenarios. (arXiv:2010.15531v1 [eess.SY])

In this paper, a unified multi-vehicle formation control framework for Err codemadness.org 70 i 3979 Intelligent and Connected Vehicles (ICVs) that can apply to multiple traffic Err codemadness.org 70 i 3980 scenarios is proposed. In the one-dimensional scenario, different formation Err codemadness.org 70 i 3981 geometries are analyzed and the interlaced structure is mathematically Err codemadness.org 70 i 3982 modelized to improve driving safety while making full use of the lane capacity. Err codemadness.org 70 i 3983 The assignment problem for vehicles and target positions is solved using Err codemadness.org 70 i 3984 Hungarian Algorithm to improve the flexibility of the method in multiple Err codemadness.org 70 i 3985 scenarios. In the two-dimensional scenario, an improved virtual platoon method Err codemadness.org 70 i 3986 is proposed to transfer the complex two-dimensional passing problem to the Err codemadness.org 70 i 3987 one-dimensional formation control problem based on the idea of rotation Err codemadness.org 70 i 3988 projection. Besides, the vehicle regrouping method is proposed to connect the Err codemadness.org 70 i 3989 two scenarios. Simulation results prove that the proposed multi-vehicle Err codemadness.org 70 i 3990 formation control framework can apply to multiple typical scenarios and have Err codemadness.org 70 i 3991 better performance than existing methods. Err codemadness.org 70 i 3992

Err codemadness.org 70 i 3993

How do Offline Measures for Exploration in Reinforcement Learning behave?. (arXiv:2010.15533v1 [cs.LG])

Sufficient exploration is paramount for the success of a reinforcement Err codemadness.org 70 i 4000 learning agent. Yet, exploration is rarely assessed in an algorithm-independent Err codemadness.org 70 i 4001 way. We compare the behavior of three data-based, offline exploration metrics Err codemadness.org 70 i 4002 described in the literature on intuitive simple distributions and highlight Err codemadness.org 70 i 4003 problems to be aware of when using them. We propose a fourth metric,uniform Err codemadness.org 70 i 4004 relative entropy, and implement it using either a k-nearest-neighbor or a Err codemadness.org 70 i 4005 nearest-neighbor-ratio estimator, highlighting that the implementation choices Err codemadness.org 70 i 4006 have a profound impact on these measures. Err codemadness.org 70 i 4007

Err codemadness.org 70 i 4008

Poster: Benchmarking Financial Data Feed Systems. (arXiv:2010.15534v1 [cs.PF])

Data-driven solutions for the investment industry require event-based backend Err codemadness.org 70 i 4015 systems to process high-volume financial data feeds with low latency, high Err codemadness.org 70 i 4016 throughput, and guaranteed delivery modes. Err codemadness.org 70 i 4017

Err codemadness.org 70 i 4018

At vwd we process an average of 18 billion incoming event notifications from Err codemadness.org 70 i 4019 500+ data sources for 30 million symbols per day and peak rates of 1+ million Err codemadness.org 70 i 4020 notifications per second using custom-built platforms that keep audit logs of Err codemadness.org 70 i 4021 every event. Err codemadness.org 70 i 4022

Err codemadness.org 70 i 4023

We currently assess modern open source event-processing platforms such as Err codemadness.org 70 i 4024 Kafka, NATS, Redis, Flink or Storm for the use in our ticker plant to reduce Err codemadness.org 70 i 4025 the maintenance effort for cross-cutting concerns and leverage hybrid Err codemadness.org 70 i 4026 deployment models. For comparability and repeatability we benchmark candidates Err codemadness.org 70 i 4027 with a standardized workload we derived from our real data feeds. Err codemadness.org 70 i 4028

Err codemadness.org 70 i 4029

We have enhanced an existing light-weight open source benchmarking tool in Err codemadness.org 70 i 4030 its processing, logging, and reporting capabilities to cope with our workloads. Err codemadness.org 70 i 4031 The resulting tool wrench can simulate workloads or replay snapshots in volume Err codemadness.org 70 i 4032 and dynamics like those we process in our ticker plant. We provide the tool as Err codemadness.org 70 i 4033 open source. Err codemadness.org 70 i 4034

Err codemadness.org 70 i 4035

As part of ongoing work we contribute details on (a) our workload and Err codemadness.org 70 i 4036 requirements for benchmarking candidate platforms for financial feed Err codemadness.org 70 i 4037 processing; (b) the current state of the tool wrench. Err codemadness.org 70 i 4038

Err codemadness.org 70 i 4039

Unbabel's Participation in the WMT20 Metrics Shared Task. (arXiv:2010.15535v1 [cs.CL])

We present the contribution of the Unbabel team to the WMT 2020 Shared Task Err codemadness.org 70 i 4046 on Metrics. We intend to participate on the segment-level, document-level and Err codemadness.org 70 i 4047 system-level tracks on all language pairs, as well as the 'QE as a Metric' Err codemadness.org 70 i 4048 track. Accordingly, we illustrate results of our models in these tracks with Err codemadness.org 70 i 4049 reference to test sets from the previous year. Our submissions build upon the Err codemadness.org 70 i 4050 recently proposed COMET framework: We train several estimator models to regress Err codemadness.org 70 i 4051 on different human-generated quality scores and a novel ranking model trained Err codemadness.org 70 i 4052 on relative ranks obtained from Direct Assessments. We also propose a simple Err codemadness.org 70 i 4053 technique for converting segment-level predictions into a document-level score. Err codemadness.org 70 i 4054 Overall, our systems achieve strong results for all language pairs on previous Err codemadness.org 70 i 4055 test sets and in many cases set a new state-of-the-art. Err codemadness.org 70 i 4056

Err codemadness.org 70 i 4057

Matern Gaussian Processes on Graphs. (arXiv:2010.15538v1 [stat.ML])

Gaussian processes are a versatile framework for learning unknown functions Err codemadness.org 70 i 4064 in a manner that permits one to utilize prior information about their Err codemadness.org 70 i 4065 properties. Although many different Gaussian process models are readily Err codemadness.org 70 i 4066 available when the input space is Euclidean, the choice is much more limited Err codemadness.org 70 i 4067 for Gaussian processes whose input space is an undirected graph. In this work, Err codemadness.org 70 i 4068 we leverage the stochastic partial differential equation characterization of Err codemadness.org 70 i 4069 Mat\'{e}rn Gaussian processes - a widely-used model class in the Euclidean Err codemadness.org 70 i 4070 setting - to study their analog for undirected graphs. We show that the Err codemadness.org 70 i 4071 resulting Gaussian processes inherit various attractive properties of their Err codemadness.org 70 i 4072 Euclidean and Riemannian analogs and provide techniques that allow them to be Err codemadness.org 70 i 4073 trained using standard methods, such as inducing points. This enables graph Err codemadness.org 70 i 4074 Mat\'{e}rn Gaussian processes to be employed in mini-batch and non-conjugate Err codemadness.org 70 i 4075 settings, thereby making them more accessible to practitioners and easier to Err codemadness.org 70 i 4076 deploy within larger learning frameworks. Err codemadness.org 70 i 4077

Err codemadness.org 70 i 4078

Micromagnetics of thin films in the presence of Dzyaloshinskii-Moriya interaction. (arXiv:2010.15541v1 [math.AP])

In this paper, we study the thin-film limit of the micromagnetic energy Err codemadness.org 70 i 4085 functional in the presence of bulk Dzyaloshinskii-Moriya interaction (DMI). Our Err codemadness.org 70 i 4086 analysis includes both a stationary $\Gamma$-convergence result for the Err codemadness.org 70 i 4087 micromagnetic energy, as well as the identification of the asymptotic behavior Err codemadness.org 70 i 4088 of the associated Landau-Lifshitz-Gilbert equation. In particular, we prove Err codemadness.org 70 i 4089 that, in the limiting model, part of the DMI term behaves like the projection Err codemadness.org 70 i 4090 of the magnetic moment onto the normal to the film, contributing this way to an Err codemadness.org 70 i 4091 increase in the shape anisotropy arising from the magnetostatic self-energy. Err codemadness.org 70 i 4092 Finally, we discuss a convergent finite element approach for the approximation Err codemadness.org 70 i 4093 of the time-dependent case and use it to numerically compare the original Err codemadness.org 70 i 4094 three-dimensional model with the two-dimensional thin-film limit. Err codemadness.org 70 i 4095

Err codemadness.org 70 i 4096

Systematic literature review protocol Identification and classification of feature modeling errors. (arXiv:2010.15545v1 [cs.SE])

Context: The importance of feature modeling languages for software product Err codemadness.org 70 i 4103 lines and the planning stage for a systematic literature review. Objective: A Err codemadness.org 70 i 4104 protocol for carrying out a systematic literature review about the evidence for Err codemadness.org 70 i 4105 identifying and classifying the errors in feature modeling languages. Method: Err codemadness.org 70 i 4106 The definition of a protocol to conduct a systematic literature review Err codemadness.org 70 i 4107 according to the guidelines of B. Kitchenham. Results: A validated protocol to Err codemadness.org 70 i 4108 conduct a systematic literature review. Conclusions: A proposal for the Err codemadness.org 70 i 4109 protocol definition of a systematic literature review about the identification Err codemadness.org 70 i 4110 and classification of errors in feature modeling was built. Initial results Err codemadness.org 70 i 4111 show that the effects and results for solving these errors should be carried Err codemadness.org 70 i 4112 out. Err codemadness.org 70 i 4113

Err codemadness.org 70 i 4114

Multi-Constitutive Neural Network for Large Deformation Poromechanics Problem. (arXiv:2010.15549v1 [cs.LG])

In this paper, we study the problem of large-strain consolidation in Err codemadness.org 70 i 4121 poromechanics with deep neural networks. Given different material properties Err codemadness.org 70 i 4122 and different loading conditions, the goal is to predict pore pressure and Err codemadness.org 70 i 4123 settlement. We propose a novel method "multi-constitutive neural network" Err codemadness.org 70 i 4124 (MCNN) such that one model can solve several different constitutive laws. We Err codemadness.org 70 i 4125 introduce a one-hot encoding vector as an additional input vector, which is Err codemadness.org 70 i 4126 used to label the constitutive law we wish to solve. Then we build a DNN which Err codemadness.org 70 i 4127 takes as input (X, t) along with a constitutive model label and outputs the Err codemadness.org 70 i 4128 corresponding solution. It is the first time, to our knowledge, that we can Err codemadness.org 70 i 4129 evaluate multi-constitutive laws through only one training process while still Err codemadness.org 70 i 4130 obtaining good accuracies. We found that MCNN trained to solve multiple PDEs Err codemadness.org 70 i 4131 outperforms individual neural network solvers trained with PDE. Err codemadness.org 70 i 4132

Err codemadness.org 70 i 4133

ADABOOK & MULTIBOOK: Adaptive Boosting with Chance Correction. (arXiv:2010.15550v1 [cs.LG])

There has been considerable interest in boosting and bagging, including the Err codemadness.org 70 i 4140 combination of the adaptive techniques of AdaBoost with the random selection Err codemadness.org 70 i 4141 with replacement techniques of Bagging. At the same time there has been a Err codemadness.org 70 i 4142 revisiting of the way we evaluate, with chance-corrected measures like Kappa, Err codemadness.org 70 i 4143 Informedness, Correlation or ROC AUC being advocated. This leads to the Err codemadness.org 70 i 4144 question of whether learning algorithms can do better by optimizing an Err codemadness.org 70 i 4145 appropriate chance corrected measure. Indeed, it is possible for a weak learner Err codemadness.org 70 i 4146 to optimize Accuracy to the detriment of the more reaslistic chance-corrected Err codemadness.org 70 i 4147 measures, and when this happens the booster can give up too early. This Err codemadness.org 70 i 4148 phenomenon is known to occur with conventional Accuracy-based AdaBoost, and the Err codemadness.org 70 i 4149 MultiBoost algorithm has been developed to overcome such problems using restart Err codemadness.org 70 i 4150 techniques based on bagging. This paper thus complements the theoretical work Err codemadness.org 70 i 4151 showing the necessity of using chance-corrected measures for evaluation, with Err codemadness.org 70 i 4152 empirical work showing how use of a chance-corrected measure can improve Err codemadness.org 70 i 4153 boosting. We show that the early surrender problem occurs in MultiBoost too, in Err codemadness.org 70 i 4154 multiclass situations, so that chance-corrected AdaBook and Multibook can beat Err codemadness.org 70 i 4155 standard Multiboost or AdaBoost, and we further identify which chance-corrected Err codemadness.org 70 i 4156 measures to use when. Err codemadness.org 70 i 4157

Err codemadness.org 70 i 4158

Investigating the Robustness of Artificial Intelligent Algorithms with Mixture Experiments. (arXiv:2010.15551v1 [stat.ML])

Artificial intelligent (AI) algorithms, such as deep learning and XGboost, Err codemadness.org 70 i 4165 are used in numerous applications including computer vision, autonomous Err codemadness.org 70 i 4166 driving, and medical diagnostics. The robustness of these AI algorithms is of Err codemadness.org 70 i 4167 great interest as inaccurate prediction could result in safety concerns and Err codemadness.org 70 i 4168 limit the adoption of AI systems. In this paper, we propose a framework based Err codemadness.org 70 i 4169 on design of experiments to systematically investigate the robustness of AI Err codemadness.org 70 i 4170 classification algorithms. A robust classification algorithm is expected to Err codemadness.org 70 i 4171 have high accuracy and low variability under different application scenarios. Err codemadness.org 70 i 4172 The robustness can be affected by a wide range of factors such as the imbalance Err codemadness.org 70 i 4173 of class labels in the training dataset, the chosen prediction algorithm, the Err codemadness.org 70 i 4174 chosen dataset of the application, and a change of distribution in the training Err codemadness.org 70 i 4175 and test datasets. To investigate the robustness of AI classification Err codemadness.org 70 i 4176 algorithms, we conduct a comprehensive set of mixture experiments to collect Err codemadness.org 70 i 4177 prediction performance results. Then statistical analyses are conducted to Err codemadness.org 70 i 4178 understand how various factors affect the robustness of AI classification Err codemadness.org 70 i 4179 algorithms. We summarize our findings and provide suggestions to practitioners Err codemadness.org 70 i 4180 in AI applications. Err codemadness.org 70 i 4181

Err codemadness.org 70 i 4182

Successive Halving Top-k Operator. (arXiv:2010.15552v1 [cs.LG])

We propose a differentiable successive halving method of relaxing the top-k Err codemadness.org 70 i 4189 operator, rendering gradient-based optimization possible. The need to perform Err codemadness.org 70 i 4190 softmax iteratively on the entire vector of scores is avoided by using a Err codemadness.org 70 i 4191 tournament-style selection. As a result, a much better approximation of top-k Err codemadness.org 70 i 4192 with lower computational cost is achieved compared to the previous approach. Err codemadness.org 70 i 4193

Err codemadness.org 70 i 4194

Modulation Pattern Detection Using Complex Convolutions in Deep Learning. (arXiv:2010.15556v1 [cs.LG])

Transceivers used for telecommunications transmit and receive specific Err codemadness.org 70 i 4201 modulation patterns that are represented as sequences of complex numbers. Err codemadness.org 70 i 4202 Classifying modulation patterns is challenging because noise and channel Err codemadness.org 70 i 4203 impairments affect the signals in complicated ways such that the received Err codemadness.org 70 i 4204 signal bears little resemblance to the transmitted signal. Although deep Err codemadness.org 70 i 4205 learning approaches have shown great promise over statistical methods in this Err codemadness.org 70 i 4206 problem space, deep learning frameworks continue to lag in support for Err codemadness.org 70 i 4207 complex-valued data. To address this gap, we study the implementation and use Err codemadness.org 70 i 4208 of complex convolutions in a series of convolutional neural network Err codemadness.org 70 i 4209 architectures. Replacement of data structure and convolution operations by Err codemadness.org 70 i 4210 their complex generalization in an architecture improves performance, with Err codemadness.org 70 i 4211 statistical significance, at recognizing modulation patterns in complex-valued Err codemadness.org 70 i 4212 signals with high SNR after being trained on low SNR signals. This suggests Err codemadness.org 70 i 4213 complex-valued convolutions enables networks to learn more meaningful Err codemadness.org 70 i 4214 representations. We investigate this hypothesis by comparing the features Err codemadness.org 70 i 4215 learned in each experiment by visualizing the inputs that results in one-hot Err codemadness.org 70 i 4216 modulation pattern classification for each network. Err codemadness.org 70 i 4217

Err codemadness.org 70 i 4218

Quantum Computing: A Taxonomy, Systematic Review and Future Directions. (arXiv:2010.15559v1 [cs.ET])

Quantum computing is an emerging paradigm with the potential to offer Err codemadness.org 70 i 4225 significant computational advantage over conventional classical computing by Err codemadness.org 70 i 4226 exploiting quantum-mechanical principles such as entanglement and Err codemadness.org 70 i 4227 superposition. It is anticipated that this computational advantage of quantum Err codemadness.org 70 i 4228 computing will help to solve many complex and computationally intractable Err codemadness.org 70 i 4229 problems in several areas of research such as drug design, data science, clean Err codemadness.org 70 i 4230 energy, finance, industrial chemical development, secure communications, and Err codemadness.org 70 i 4231 quantum chemistry, among others. In recent years, tremendous progress in both Err codemadness.org 70 i 4232 quantum hardware development and quantum software/algorithm have brought Err codemadness.org 70 i 4233 quantum computing much closer to reality. As the quantum devices are expected Err codemadness.org 70 i 4234 to steadily scale up in the next few years, quantum decoherence and qubit Err codemadness.org 70 i 4235 interconnectivity are two of the major challenges to achieve quantum advantage Err codemadness.org 70 i 4236 in the NISQ era. Quantum computing is a highly topical and fast-moving field of Err codemadness.org 70 i 4237 research with significant ongoing progress in all facets. A systematic review Err codemadness.org 70 i 4238 of the existing literature on quantum computing will be invaluable to Err codemadness.org 70 i 4239 understand the current status of this emerging field and identify open Err codemadness.org 70 i 4240 challenges for the quantum computing community in the coming years. This review Err codemadness.org 70 i 4241 article presents a comprehensive review of quantum computing literature, and Err codemadness.org 70 i 4242 taxonomy of quantum computing. Further, the proposed taxonomy is used to map Err codemadness.org 70 i 4243 various related studies to identify the research gaps. A detailed overview of Err codemadness.org 70 i 4244 quantum software tools and technologies, post-quantum cryptography and quantum Err codemadness.org 70 i 4245 computer hardware development to document the current state-of-the-art in the Err codemadness.org 70 i 4246 respective areas. We finish the article by highlighting various open challenges Err codemadness.org 70 i 4247 and promising future directions for research. Err codemadness.org 70 i 4248

Err codemadness.org 70 i 4249

Genetic U-Net: Automatically Designing Lightweight U-shaped CNN Architectures Using the Genetic Algorithm for Retinal Vessel Segmentation. (arXiv:2010.15560v1 [eess.IV])

Many previous works based on deep learning for retinal vessel segmentation Err codemadness.org 70 i 4256 have achieved promising performance by manually designing U-shaped Err codemadness.org 70 i 4257 convolutional neural networks (CNNs). However, the manual design of these CNNs Err codemadness.org 70 i 4258 is time-consuming and requires extensive empirical knowledge. To address this Err codemadness.org 70 i 4259 problem, we propose a novel method using genetic algorithms (GAs) to Err codemadness.org 70 i 4260 automatically design a lightweight U-shaped CNN for retinal vessel Err codemadness.org 70 i 4261 segmentation, called Genetic U-Net. Here we first design a special search space Err codemadness.org 70 i 4262 containing the structure of U-Net and its corresponding operations, and then Err codemadness.org 70 i 4263 use genetic algorithm to search for superior architectures in this search Err codemadness.org 70 i 4264 space. Experimental results show that the proposed method outperforms the Err codemadness.org 70 i 4265 existing methods on three public datasets, DRIVE, CHASE_DB1 and STARE. In Err codemadness.org 70 i 4266 addition, the architectures obtained by the proposed method are more Err codemadness.org 70 i 4267 lightweight but robust than the state-of-the-art models. Err codemadness.org 70 i 4268

Err codemadness.org 70 i 4269

Federated Transfer Learning: concept and applications. (arXiv:2010.15561v1 [cs.LG])

Development of Artificial Intelligence (AI) is inherently tied to the Err codemadness.org 70 i 4276 development of data. However, in most industries data exists in form of Err codemadness.org 70 i 4277 isolated islands, with limited scope of sharing between different Err codemadness.org 70 i 4278 organizations. This is an hindrance to the further development of AI. Federated Err codemadness.org 70 i 4279 learning has emerged as a possible solution to this problem in the last few Err codemadness.org 70 i 4280 years without compromising user privacy. Among different variants of the Err codemadness.org 70 i 4281 federated learning, noteworthy is federated transfer learning (FTL) that allows Err codemadness.org 70 i 4282 knowledge to be transferred across domains that do not have many overlapping Err codemadness.org 70 i 4283 features and users. In this work we provide a comprehensive survey of the Err codemadness.org 70 i 4284 existing works on this topic. In more details, we study the background of FTL Err codemadness.org 70 i 4285 and its different existing applications. We further analyze FTL from privacy Err codemadness.org 70 i 4286 and machine learning perspective. Err codemadness.org 70 i 4287

Err codemadness.org 70 i 4288

Limitations of the recall capabilities in delay based reservoir computing systems. (arXiv:2010.15562v1 [cs.ET])

We analyze the memory capacity of a delay based reservoir computer with a Err codemadness.org 70 i 4295 Hopf normal form as nonlinearity and numerically compute the linear as well as Err codemadness.org 70 i 4296 the higher order recall capabilities. A possible physical realisation could be Err codemadness.org 70 i 4297 a laser with external cavity, for which the information is fed via electrical Err codemadness.org 70 i 4298 injection. A task independent quantification of the computational capability of Err codemadness.org 70 i 4299 the reservoir system is done via a complete orthonormal set of basis functions. Err codemadness.org 70 i 4300 Our results suggest that even for constant readout dimension the total memory Err codemadness.org 70 i 4301 capacity is dependent on the ratio between the information input period, also Err codemadness.org 70 i 4302 called the clock cycle, and the time delay in the system. Optimal performance Err codemadness.org 70 i 4303 is found for a time delay about 1.6 times the clock cycle Err codemadness.org 70 i 4304

Err codemadness.org 70 i 4305

Overcoming The Limitations of Neural Networks in Composite-Pattern Learning with Architopes. (arXiv:2010.15571v1 [cs.NE])

The effectiveness of neural networks in solving complex problems is well Err codemadness.org 70 i 4312 recognized; however, little is known about their limitations. We demonstrate Err codemadness.org 70 i 4313 that the feed-forward architecture, for most commonly used activation Err codemadness.org 70 i 4314 functions, is incapable of approximating functions comprised of multiple Err codemadness.org 70 i 4315 sub-patterns while simultaneously respecting their composite-pattern structure. Err codemadness.org 70 i 4316 We overcome this bottleneck with a simple architecture modification that Err codemadness.org 70 i 4317 reallocates the neurons of any single feed-forward network across several Err codemadness.org 70 i 4318 smaller sub-networks, each specialized on a distinct part of the input-space. Err codemadness.org 70 i 4319 The modified architecture, called an Architope, is more expressive on two Err codemadness.org 70 i 4320 fronts. First, it is dense in an associated space of piecewise continuous Err codemadness.org 70 i 4321 functions in which the feed-forward architecture is not dense. Second, it Err codemadness.org 70 i 4322 achieves the same approximation rate as the feed-forward networks while only Err codemadness.org 70 i 4323 requiring $\mathscr{O}(N^{-1})$ fewer parameters in its hidden layers. Err codemadness.org 70 i 4324 Moreover, the architecture achieves these approximation improvements while Err codemadness.org 70 i 4325 preserving the target's composite-pattern structure. Err codemadness.org 70 i 4326

Err codemadness.org 70 i 4327

Experimental Analysis of Communication Relaying Delay in Low-Energy Ad-hoc Networks. (arXiv:2010.15572v1 [cs.NI])

In recent years, more and more applications use ad-hoc networks for local M2M Err codemadness.org 70 i 4334 communications, but in some cases such as when using WSNs, the software Err codemadness.org 70 i 4335 processing delay induced by packets relaying may not be negligible. In this Err codemadness.org 70 i 4336 paper, we planned and carried out a delay measurement experiment using Err codemadness.org 70 i 4337 Raspberry Pi Zero W. The results demonstrated that, in low-energy ad-hoc Err codemadness.org 70 i 4338 networks, processing delay of the application is always too large to ignore; it Err codemadness.org 70 i 4339 is at least ten times greater than the kernel routing and corresponds to 30% of Err codemadness.org 70 i 4340 the transmission delay. Furthermore, if the task is CPU-intensive, such as Err codemadness.org 70 i 4341 packet encryption, the processing delay can be greater than the transmission Err codemadness.org 70 i 4342 delay and its behavior is represented by a simple linear model. Our findings Err codemadness.org 70 i 4343 indicate that the key factor for achieving QoS in ad-hoc networks is an Err codemadness.org 70 i 4344 appropriate node-to-node load balancing that takes into account the CPU Err codemadness.org 70 i 4345 performance and the amount of traffic passing through each node. Err codemadness.org 70 i 4346

Err codemadness.org 70 i 4347

Import test questions into Moodle LMS. (arXiv:2010.15577v1 [cs.CY])

The purpose of the study is to highlight the theoretical and methodological Err codemadness.org 70 i 4354 aspects of preparing the test questions of the most common types in the form of Err codemadness.org 70 i 4355 text files for further import into learning management system (LMS) Moodle. The Err codemadness.org 70 i 4356 subject of the research is the automated filling of the Moodle LMS test Err codemadness.org 70 i 4357 database. The objectives of the study: to analyze the import files of test Err codemadness.org 70 i 4358 questions, their advantages and disadvantages; to develop guidelines for the Err codemadness.org 70 i 4359 preparation of test questions of common types in the form of text files for Err codemadness.org 70 i 4360 further import into Moodle LMS. The action algorithms for importing questions Err codemadness.org 70 i 4361 and instructions for submitting question files in such formats as Aiken, GIFT, Err codemadness.org 70 i 4362 Moodle XML, "True/False" questions, "Multiple Choice" (one of many and many of Err codemadness.org 70 i 4363 many), "Matching", with an open answer - "Numerical" or "Short answer" and Err codemadness.org 70 i 4364 "Essay" are offered in this article. The formats for submitting questions, Err codemadness.org 70 i 4365 examples of its designing and developed questions were demonstrated in view Err codemadness.org 70 i 4366 mode in Moodle LMS. Err codemadness.org 70 i 4367

Err codemadness.org 70 i 4368

Exploring the Nuances of Designing (with/for) Artificial Intelligence. (arXiv:2010.15578v1 [cs.CY])

Solutions relying on artificial intelligence are devised to predict data Err codemadness.org 70 i 4375 patterns and answer questions that are clearly defined, involve an enumerable Err codemadness.org 70 i 4376 set of solutions, clear rules, and inherently binary decision mechanisms. Yet, Err codemadness.org 70 i 4377 as they become exponentially implemented in our daily activities, they begin to Err codemadness.org 70 i 4378 transcend these initial boundaries and to affect the larger sociotechnical Err codemadness.org 70 i 4379 system in which they are situated. In this arrangement, a solution is under Err codemadness.org 70 i 4380 pressure to surpass true or false criteria and move to an ethical evaluation of Err codemadness.org 70 i 4381 right and wrong. Neither algorithmic solutions, nor purely humanistic ones will Err codemadness.org 70 i 4382 be enough to fully mitigate undesirable outcomes in the narrow state of AI or Err codemadness.org 70 i 4383 its future incarnations. We must take a holistic view. In this paper we explore Err codemadness.org 70 i 4384 the construct of infrastructure as a means to simultaneously address Err codemadness.org 70 i 4385 algorithmic and societal issues when designing AI. Err codemadness.org 70 i 4386

Err codemadness.org 70 i 4387

Modeling biomedical breathing signals with convolutional deep probabilistic autoencoders. (arXiv:2010.15579v1 [cs.LG])

One of the main problems with biomedical signals is the limited amount of Err codemadness.org 70 i 4394 patient-specific data and the significant amount of time needed to record a Err codemadness.org 70 i 4395 sufficient number of samples for diagnostic and treatment purposes. We explore Err codemadness.org 70 i 4396 the use of Variational Autoencoder (VAE) and Adversarial Autoencoder (AAE) Err codemadness.org 70 i 4397 algorithms based on one-dimensional convolutional neural networks in order to Err codemadness.org 70 i 4398 build generative models able to capture and represent the variability of a set Err codemadness.org 70 i 4399 of unlabeled quasi-periodic signals using as few as 10 parameters. Furthermore, Err codemadness.org 70 i 4400 we introduce a modified AAE architecture that allows simultaneous Err codemadness.org 70 i 4401 semi-supervised classification and generation of different types of signals. Err codemadness.org 70 i 4402 Our study is based on physical breathing signals, i.e. time series describing Err codemadness.org 70 i 4403 the position of chest markers, generally used to describe respiratory motion. Err codemadness.org 70 i 4404 The time series are discretized into a vector of periods, with each period Err codemadness.org 70 i 4405 containing 6 time and position values. These vectors can be transformed back Err codemadness.org 70 i 4406 into time series through an additional reconstruction neural network and allow Err codemadness.org 70 i 4407 to generate extended signals while simplifying the modeling task. The obtained Err codemadness.org 70 i 4408 models can be used to generate realistic breathing realizations from patient or Err codemadness.org 70 i 4409 population data and to classify new recordings. We show that by incorporating Err codemadness.org 70 i 4410 the labels from around 10-15\% of the dataset during training, the model can be Err codemadness.org 70 i 4411 guided to group data according to the patient it belongs to, or based on the Err codemadness.org 70 i 4412 presence of different types of breathing irregularities such as baseline Err codemadness.org 70 i 4413 shifts. Our specific motivation is to model breathing motion during Err codemadness.org 70 i 4414 radiotherapy lung cancer treatments, for which the developed model serves as an Err codemadness.org 70 i 4415 efficient tool to robustify plans against breathing uncertainties. However, the Err codemadness.org 70 i 4416 same methodology can in principle be applied to any other kind of Err codemadness.org 70 i 4417 quasi-periodic biomedical signal, representing a generically applicable tool. Err codemadness.org 70 i 4418

Err codemadness.org 70 i 4419

The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Research. (arXiv:2010.15581v1 [cs.CY])

Increasingly, modern Artificial Intelligence (AI) research has become more Err codemadness.org 70 i 4426 computationally intensive. However, a growing concern is that due to unequal Err codemadness.org 70 i 4427 access to computing power, only certain firms and elite universities have Err codemadness.org 70 i 4428 advantages in modern AI research. Using a novel dataset of 171394 papers from Err codemadness.org 70 i 4429 57 prestigious computer science conferences, we document that firms, in Err codemadness.org 70 i 4430 particular, large technology firms and elite universities have increased Err codemadness.org 70 i 4431 participation in major AI conferences since deep learning's unanticipated rise Err codemadness.org 70 i 4432 in 2012. The effect is concentrated among elite universities, which are ranked Err codemadness.org 70 i 4433 1-50 in the QS World University Rankings. Further, we find two strategies Err codemadness.org 70 i 4434 through which firms increased their presence in AI research: first, they have Err codemadness.org 70 i 4435 increased firm-only publications; and second, firms are collaborating primarily Err codemadness.org 70 i 4436 with elite universities. Consequently, this increased presence of firms and Err codemadness.org 70 i 4437 elite universities in AI research has crowded out mid-tier (QS ranked 201-300) Err codemadness.org 70 i 4438 and lower-tier (QS ranked 301-500) universities. To provide causal evidence Err codemadness.org 70 i 4439 that deep learning's unanticipated rise resulted in this divergence, we Err codemadness.org 70 i 4440 leverage the generalized synthetic control method, a data-driven counterfactual Err codemadness.org 70 i 4441 estimator. Using machine learning based text analysis methods, we provide Err codemadness.org 70 i 4442 additional evidence that the divergence between these two groups - large firms Err codemadness.org 70 i 4443 and non-elite universities - is driven by access to computing power or compute, Err codemadness.org 70 i 4444 which we term as the "compute divide". This compute divide between large firms Err codemadness.org 70 i 4445 and non-elite universities increases concerns around bias and fairness within Err codemadness.org 70 i 4446 AI technology, and presents an obstacle towards "democratizing" AI. These Err codemadness.org 70 i 4447 results suggest that a lack of access to specialized equipment such as compute Err codemadness.org 70 i 4448 can de-democratize knowledge production. Err codemadness.org 70 i 4449

Err codemadness.org 70 i 4450

Improving Accuracy of Federated Learning in Non-IID Settings. (arXiv:2010.15582v1 [cs.LG])

Federated Learning (FL) is a decentralized machine learning protocol that Err codemadness.org 70 i 4457 allows a set of participating agents to collaboratively train a model without Err codemadness.org 70 i 4458 sharing their data. This makes FL particularly suitable for settings where data Err codemadness.org 70 i 4459 privacy is desired. However, it has been observed that the performance of FL is Err codemadness.org 70 i 4460 closely tied with the local data distributions of agents. Particularly, in Err codemadness.org 70 i 4461 settings where local data distributions vastly differ among agents, FL performs Err codemadness.org 70 i 4462 rather poorly with respect to the centralized training. To address this Err codemadness.org 70 i 4463 problem, we hypothesize the reasons behind the performance degradation, and Err codemadness.org 70 i 4464 develop some techniques to address these reasons accordingly. In this work, we Err codemadness.org 70 i 4465 identify four simple techniques that can improve the performance of trained Err codemadness.org 70 i 4466 models without incurring any additional communication overhead to FL, but Err codemadness.org 70 i 4467 rather, some light computation overhead either on the client, or the Err codemadness.org 70 i 4468 server-side. In our experimental analysis, combination of our techniques Err codemadness.org 70 i 4469 improved the validation accuracy of a model trained via FL by more than 12% Err codemadness.org 70 i 4470 with respect to our baseline. This is about 5% less than the accuracy of the Err codemadness.org 70 i 4471 model trained on centralized data. Err codemadness.org 70 i 4472

Err codemadness.org 70 i 4473

Probabilistic Transformers. (arXiv:2010.15583v1 [cs.LG])

We show that Transformers are Maximum Posterior Probability estimators for Err codemadness.org 70 i 4480 Mixtures of Gaussian Models. This brings a probabilistic point of view to Err codemadness.org 70 i 4481 Transformers and suggests extensions to other probabilistic cases. Err codemadness.org 70 i 4482

Err codemadness.org 70 i 4483

Future Directions of the Cyberinfrastructure for Sustained Scientific Innovation (CSSI) Program. (arXiv:2010.15584v1 [cs.CY])

The CSSI 2019 workshop was held on October 28-29, 2019, in Austin, Texas. The Err codemadness.org 70 i 4490 main objectives of this workshop were to (1) understand the impact of the CSSI Err codemadness.org 70 i 4491 program on the community over the last 9 years, (2) engage workshop Err codemadness.org 70 i 4492 participants in identifying gaps and opportunities in the current CSSI Err codemadness.org 70 i 4493 landscape, (3) gather ideas on the cyberinfrastructure needs and expectations Err codemadness.org 70 i 4494 of the community with respect to the CSSI program, and (4) prepare a report Err codemadness.org 70 i 4495 summarizing the feedback gathered from the community that can inform the future Err codemadness.org 70 i 4496 solicitations of the CSSI program. The workshop brought together different Err codemadness.org 70 i 4497 stakeholders interested in provisioning sustainable cyberinfrastructure that Err codemadness.org 70 i 4498 can power discoveries impacting the various fields of science and technology Err codemadness.org 70 i 4499 and maintaining the nation's competitiveness in the areas such as scientific Err codemadness.org 70 i 4500 software, HPC, networking, cybersecurity, and data/information science. The Err codemadness.org 70 i 4501 workshop served as a venue for gathering the community-feedback on the current Err codemadness.org 70 i 4502 state of the CSSI program and its future directions. Err codemadness.org 70 i 4503

Err codemadness.org 70 i 4504

Panel: Economic Policy and Governance during Pandemics using AI. (arXiv:2010.15585v1 [cs.CY])

The global food supply chain (starting at farms and ending with consumers) Err codemadness.org 70 i 4511 has been seriously disrupted by many outlier events such as trade wars, the Err codemadness.org 70 i 4512 China demand shock, natural disasters, and pandemics. Outlier events create Err codemadness.org 70 i 4513 uncertainty along the entire supply chain in addition to intervening policy Err codemadness.org 70 i 4514 responses to mitigate their adverse effects. Artificial Intelligence (AI) Err codemadness.org 70 i 4515 methods (i.e. machine/reinforcement/deep learning) provide an opportunity to Err codemadness.org 70 i 4516 better understand outcomes during outlier events by identifying regular, Err codemadness.org 70 i 4517 irregular and contextual components. Employing AI can provide guidance to Err codemadness.org 70 i 4518 decision making suppliers, farmers, processors, wholesalers, and retailers Err codemadness.org 70 i 4519 along the supply chain, and policy makers to facilitate welfare-improving Err codemadness.org 70 i 4520 outcomes. This panel discusses these issues. Err codemadness.org 70 i 4521

Err codemadness.org 70 i 4522

Event-Driven Learning of Systematic Behaviours in Stock Markets. (arXiv:2010.15586v1 [q-fin.ST])

It is reported that financial news, especially financial events expressed in Err codemadness.org 70 i 4529 news, provide information to investors' long/short decisions and influence the Err codemadness.org 70 i 4530 movements of stock markets. Motivated by this, we leverage financial event Err codemadness.org 70 i 4531 streams to train a classification neural network that detects latent Err codemadness.org 70 i 4532 event-stock linkages and stock markets' systematic behaviours in the U.S. stock Err codemadness.org 70 i 4533 market. Our proposed pipeline includes (1) a combined event extraction method Err codemadness.org 70 i 4534 that utilizes Open Information Extraction and neural co-reference resolution, Err codemadness.org 70 i 4535 (2) a BERT/ALBERT enhanced representation of events, and (3) an extended Err codemadness.org 70 i 4536 hierarchical attention network that includes attentions on event, news and Err codemadness.org 70 i 4537 temporal levels. Our pipeline achieves significantly better accuracies and Err codemadness.org 70 i 4538 higher simulated annualized returns than state-of-the-art models when being Err codemadness.org 70 i 4539 applied to predicting Standard\&Poor 500, Dow Jones, Nasdaq indices and 10 Err codemadness.org 70 i 4540 individual stocks. Err codemadness.org 70 i 4541

Err codemadness.org 70 i 4542

Impact of (SARS-CoV-2) COVID 19 on the indigenous language-speaking population in Mexico. (arXiv:2010.15588v1 [cs.CY])

The importance of the working document is that it allows the analysis of the Err codemadness.org 70 i 4549 information and the status of cases associated with (SARS-CoV-2) COVID-19 as Err codemadness.org 70 i 4550 open data at the municipal, state and national level, with a daily record of Err codemadness.org 70 i 4551 patients, according to a age, sex, comorbidities, for the condition of Err codemadness.org 70 i 4552 (SARS-CoV-2) COVID-19 according to the following characteristics: a) Positive, Err codemadness.org 70 i 4553 b) Negative, c) Suspicious. Likewise, it presents information related to the Err codemadness.org 70 i 4554 identification of an outpatient and / or hospitalized patient, attending to Err codemadness.org 70 i 4555 their medical development, identifying: a) Recovered, b) Deaths and c) Active, Err codemadness.org 70 i 4556 in Phase 3 and Phase 4, in the five main population areas speaker of indigenous Err codemadness.org 70 i 4557 language in the State of Veracruz - Mexico. The data analysis is carried out Err codemadness.org 70 i 4558 through the application of a data mining algorithm, which provides the Err codemadness.org 70 i 4559 information, fast and timely, required for the estimation of Medical Care Err codemadness.org 70 i 4560 Scenarios of (SARS-CoV-2) COVID-19, as well as for know the impact on the Err codemadness.org 70 i 4561 indigenous language-speaking population in Mexico. Err codemadness.org 70 i 4562

Err codemadness.org 70 i 4563

Enjeux \'ethiques de l'IA en sant\'e : une humanisation du parcours de soin par l'intelligence artificielle ?. (arXiv:2010.15590v1 [cs.CY])

Considering the use of artificial intelligence for greater personalization of Err codemadness.org 70 i 4570 patient care and better management of human and material resources may seem Err codemadness.org 70 i 4571 like an opportunity not to be missed. In order to offer a better humanization Err codemadness.org 70 i 4572 of the care pathway, artificial intelligence is a tool that decision-makers in Err codemadness.org 70 i 4573 the hospital sector must appropriate by taking care of the new ethical issues Err codemadness.org 70 i 4574 and conflicts of values that this technology generates. Err codemadness.org 70 i 4575

Err codemadness.org 70 i 4576

Envisager le recours \`a l'intelligence artificielle pour une plus grande Err codemadness.org 70 i 4577 personnalisation de la prise en charge du patient et une meilleure gestion des Err codemadness.org 70 i 4578 ressources humaines et mat\'erielles peut sembler une opportunit\'e \`a ne pas Err codemadness.org 70 i 4579 manquer. Afin de proposer une meilleure humanisation du parcours de soin, Err codemadness.org 70 i 4580 l'intelligence artificielle est un outil que les d\'ecideurs du milieu Err codemadness.org 70 i 4581 hospitalier doivent s'approprier en veillant aux nouveaux enjeux \'ethiques et Err codemadness.org 70 i 4582 conflits de valeurs que cette technologie engendre. Err codemadness.org 70 i 4583

Err codemadness.org 70 i 4584

Shared Space Transfer Learning for analyzing multi-site fMRI data. (arXiv:2010.15594v1 [cs.LG])

Multi-voxel pattern analysis (MVPA) learns predictive models from task-based Err codemadness.org 70 i 4591 functional magnetic resonance imaging (fMRI) data, for distinguishing when Err codemadness.org 70 i 4592 subjects are performing different cognitive tasks -- e.g., watching movies or Err codemadness.org 70 i 4593 making decisions. MVPA works best with a well-designed feature set and an Err codemadness.org 70 i 4594 adequate sample size. However, most fMRI datasets are noisy, high-dimensional, Err codemadness.org 70 i 4595 expensive to collect, and with small sample sizes. Further, training a robust, Err codemadness.org 70 i 4596 generalized predictive model that can analyze homogeneous cognitive tasks Err codemadness.org 70 i 4597 provided by multi-site fMRI datasets has additional challenges. This paper Err codemadness.org 70 i 4598 proposes the Shared Space Transfer Learning (SSTL) as a novel transfer learning Err codemadness.org 70 i 4599 (TL) approach that can functionally align homogeneous multi-site fMRI datasets, Err codemadness.org 70 i 4600 and so improve the prediction performance in every site. SSTL first extracts a Err codemadness.org 70 i 4601 set of common features for all subjects in each site. It then uses TL to map Err codemadness.org 70 i 4602 these site-specific features to a site-independent shared space in order to Err codemadness.org 70 i 4603 improve the performance of the MVPA. SSTL uses a scalable optimization Err codemadness.org 70 i 4604 procedure that works effectively for high-dimensional fMRI datasets. The Err codemadness.org 70 i 4605 optimization procedure extracts the common features for each site by using a Err codemadness.org 70 i 4606 single-iteration algorithm and maps these site-specific common features to the Err codemadness.org 70 i 4607 site-independent shared space. We evaluate the effectiveness of the proposed Err codemadness.org 70 i 4608 method for transferring between various cognitive tasks. Our comprehensive Err codemadness.org 70 i 4609 experiments validate that SSTL achieves superior performance to other Err codemadness.org 70 i 4610 state-of-the-art analysis techniques. Err codemadness.org 70 i 4611

Err codemadness.org 70 i 4612

Verification of Patterns. (arXiv:2010.15596v1 [cs.LO])

The software patterns provide building blocks to the design and Err codemadness.org 70 i 4619 implementation of a software system, and try to make the software engineering Err codemadness.org 70 i 4620 to progress from experience to science. The software patterns were made famous Err codemadness.org 70 i 4621 because of the introduction as the design patterns. After that, patterns have Err codemadness.org 70 i 4622 been researched and developed widely and rapidly. The series of books of Err codemadness.org 70 i 4623 pattern-oriented software architecture should be marked in the development of Err codemadness.org 70 i 4624 software patterns. As mentioned in these books, formalization of patterns and Err codemadness.org 70 i 4625 an intermediate pattern language are needed and should be developed in the Err codemadness.org 70 i 4626 future of patterns. So, in this book, we formalize software patterns according Err codemadness.org 70 i 4627 to the categories of the series of books of pattern-oriented software Err codemadness.org 70 i 4628 architecture, and verify the correctness of patterns based on truly concurrent Err codemadness.org 70 i 4629 process algebra. In one aspect, patterns are formalized and verified; in the Err codemadness.org 70 i 4630 other aspect, truly concurrent process algebra can play a role of an Err codemadness.org 70 i 4631 intermediate pattern language for its rigorous theory. Err codemadness.org 70 i 4632

Err codemadness.org 70 i 4633

Enhancing reinforcement learning by a finite reward response filter with a case study in intelligent structural control. (arXiv:2010.15597v1 [cs.LG])

In many reinforcement learning (RL) problems, it takes some time until a Err codemadness.org 70 i 4640 taken action by the agent reaches its maximum effect on the environment and Err codemadness.org 70 i 4641 consequently the agent receives the reward corresponding to that action by a Err codemadness.org 70 i 4642 delay called action-effect delay. Such delays reduce the performance of the Err codemadness.org 70 i 4643 learning algorithm and increase the computational costs, as the reinforcement Err codemadness.org 70 i 4644 learning agent values the immediate rewards more than the future reward that is Err codemadness.org 70 i 4645 more related to the taken action. This paper addresses this issue by Err codemadness.org 70 i 4646 introducing an applicable enhanced Q-learning method in which at the beginning Err codemadness.org 70 i 4647 of the learning phase, the agent takes a single action and builds a function Err codemadness.org 70 i 4648 that reflects the environments response to that action, called the reflexive Err codemadness.org 70 i 4649 $\gamma$ - function. During the training phase, the agent utilizes the created Err codemadness.org 70 i 4650 reflexive $\gamma$- function to update the Q-values. We have applied the Err codemadness.org 70 i 4651 developed method to a structural control problem in which the goal of the agent Err codemadness.org 70 i 4652 is to reduce the vibrations of a building subjected to earthquake excitations Err codemadness.org 70 i 4653 with a specified delay. Seismic control problems are considered as a complex Err codemadness.org 70 i 4654 task in structural engineering because of the stochastic and unpredictable Err codemadness.org 70 i 4655 nature of earthquakes and the complex behavior of the structure. Three Err codemadness.org 70 i 4656 scenarios are presented to study the effects of zero, medium, and long Err codemadness.org 70 i 4657 action-effect delays and the performance of the Enhanced method is compared to Err codemadness.org 70 i 4658 the standard Q-learning method. Both RL methods use neural network to learn to Err codemadness.org 70 i 4659 estimate the state-action value function that is used to control the structure. Err codemadness.org 70 i 4660 The results show that the enhanced method significantly outperforms the Err codemadness.org 70 i 4661 performance of the original method in all cases, and also improves the Err codemadness.org 70 i 4662 stability of the algorithm in dealing with action-effect delays. Err codemadness.org 70 i 4663

Err codemadness.org 70 i 4664

May I Ask Who's Calling? Named Entity Recognition on Call Center Transcripts for Privacy Law Compliance. (arXiv:2010.15598v1 [cs.CL])

We investigate using Named Entity Recognition on a new type of user-generated Err codemadness.org 70 i 4671 text: a call center conversation. These conversations combine problems from Err codemadness.org 70 i 4672 spontaneous speech with problems novel to conversational Automated Speech Err codemadness.org 70 i 4673 Recognition, including incorrect recognition, alongside other common problems Err codemadness.org 70 i 4674 from noisy user-generated text. Using our own corpus with new annotations, Err codemadness.org 70 i 4675 training custom contextual string embeddings, and applying a BiLSTM-CRF, we Err codemadness.org 70 i 4676 match state-of-the-art results on our novel task. Err codemadness.org 70 i 4677

Err codemadness.org 70 i 4678

Expert Selection in High-Dimensional Markov Decision Processes. (arXiv:2010.15599v1 [cs.LG])

In this work we present a multi-armed bandit framework for online expert Err codemadness.org 70 i 4685 selection in Markov decision processes and demonstrate its use in Err codemadness.org 70 i 4686 high-dimensional settings. Our method takes a set of candidate expert policies Err codemadness.org 70 i 4687 and switches between them to rapidly identify the best performing expert using Err codemadness.org 70 i 4688 a variant of the classical upper confidence bound algorithm, thus ensuring low Err codemadness.org 70 i 4689 regret in the overall performance of the system. This is useful in applications Err codemadness.org 70 i 4690 where several expert policies may be available, and one needs to be selected at Err codemadness.org 70 i 4691 run-time for the underlying environment. Err codemadness.org 70 i 4692

Err codemadness.org 70 i 4693

Three computational models and its equivalence. (arXiv:2010.15600v1 [cs.LO])

The study of computability has its origin in Hilbert's conference of 1900, Err codemadness.org 70 i 4700 where an adjacent question, to the ones he asked, is to give a precise Err codemadness.org 70 i 4701 description of the notion of algorithm. In the search for a good definition Err codemadness.org 70 i 4702 arose three independent theories: Turing and the Turing machines, G\"odel and Err codemadness.org 70 i 4703 the recursive functions, Church and the Lambda Calculus. Err codemadness.org 70 i 4704

Err codemadness.org 70 i 4705

Later there were established by Kleene that the classic models of computation Err codemadness.org 70 i 4706 are equivalent. This fact is widely accepted by many textbooks and the proof is Err codemadness.org 70 i 4707 omitted since the proof is tedious and unreadable. We intend to fill this gap Err codemadness.org 70 i 4708 presenting the proof in a modern way, without forgetting the mathematical Err codemadness.org 70 i 4709 details. Err codemadness.org 70 i 4710

Err codemadness.org 70 i 4711

Using a Binary Classification Model to Predict the Likelihood of Enrolment to the Undergraduate Program of a Philippine University. (arXiv:2010.15601v1 [cs.CY])

With the recent implementation of the K to 12 Program, academic institutions, Err codemadness.org 70 i 4718 specifically, Colleges and Universities in the Philippines have been faced with Err codemadness.org 70 i 4719 difficulties in determining projected freshmen enrollees vis-a-vis Err codemadness.org 70 i 4720 decision-making factors for efficient resource management. Enrollment targets Err codemadness.org 70 i 4721 directly impacts success factors of Higher Education Institutions. This study Err codemadness.org 70 i 4722 covered an analysis of various characteristics of freshmen applicants affecting Err codemadness.org 70 i 4723 their admission status in a Philippine university. A predictive model was Err codemadness.org 70 i 4724 developed using Logistic Regression to evaluate the probability that an Err codemadness.org 70 i 4725 admitted student will pursue to enroll in the Institution or not. The dataset Err codemadness.org 70 i 4726 used was acquired from the University Admissions Office. The office designed an Err codemadness.org 70 i 4727 online application form to capture applicants' details. The online form was Err codemadness.org 70 i 4728 distributed to all student applicants, and most often, students, tend to Err codemadness.org 70 i 4729 provide incomplete information. Despite this fact, student characteristics, as Err codemadness.org 70 i 4730 well as geographic and demographic data based on the students' location are Err codemadness.org 70 i 4731 significant predictors of enrollment decision. The results of the study show Err codemadness.org 70 i 4732 that given limited information about prospective students, Higher Education Err codemadness.org 70 i 4733 Institutions can implement machine learning techniques to supplement management Err codemadness.org 70 i 4734 decisions and provide estimates of class sizes, in this way, it will allow the Err codemadness.org 70 i 4735 institution to optimize the allocation of resources and will have better Err codemadness.org 70 i 4736 control over net tuition revenue. Err codemadness.org 70 i 4737

Err codemadness.org 70 i 4738

Designing learning experiences for online teaching and learning. (arXiv:2010.15602v1 [cs.CY])

Teaching is about constantly innovating strategies, ways and means to engage Err codemadness.org 70 i 4745 diverse students in active and meaningful learning. In line with this, SUTD Err codemadness.org 70 i 4746 adopts various student-centric teaching and learning teaching methods and Err codemadness.org 70 i 4747 approaches. This means that our graduate/undergraduate instructors have to be Err codemadness.org 70 i 4748 ready to teach using these student student-centric teaching and learning Err codemadness.org 70 i 4749 pedagogies. In this article, I share my experiences of redesigning this Err codemadness.org 70 i 4750 teaching course that is typically conducted face-to-face to a synchronous Err codemadness.org 70 i 4751 online course and also invite one of the participant in this course to reflect Err codemadness.org 70 i 4752 on his experience as a student. Err codemadness.org 70 i 4753

Err codemadness.org 70 i 4754

Suppressing Mislabeled Data via Grouping and Self-Attention. (arXiv:2010.15603v1 [cs.CV])

Deep networks achieve excellent results on large-scale clean data but degrade Err codemadness.org 70 i 4761 significantly when learning from noisy labels. To suppressing the impact of Err codemadness.org 70 i 4762 mislabeled data, this paper proposes a conceptually simple yet efficient Err codemadness.org 70 i 4763 training block, termed as Attentive Feature Mixup (AFM), which allows paying Err codemadness.org 70 i 4764 more attention to clean samples and less to mislabeled ones via sample Err codemadness.org 70 i 4765 interactions in small groups. Specifically, this plug-and-play AFM first Err codemadness.org 70 i 4766 leverages a \textit{group-to-attend} module to construct groups and assign Err codemadness.org 70 i 4767 attention weights for group-wise samples, and then uses a \textit{mixup} module Err codemadness.org 70 i 4768 with the attention weights to interpolate massive noisy-suppressed samples. The Err codemadness.org 70 i 4769 AFM has several appealing benefits for noise-robust deep learning. (i) It does Err codemadness.org 70 i 4770 not rely on any assumptions and extra clean subset. (ii) With massive Err codemadness.org 70 i 4771 interpolations, the ratio of useless samples is reduced dramatically compared Err codemadness.org 70 i 4772 to the original noisy ratio. (iii) \pxj{It jointly optimizes the interpolation Err codemadness.org 70 i 4773 weights with classifiers, suppressing the influence of mislabeled data via low Err codemadness.org 70 i 4774 attention weights. (iv) It partially inherits the vicinal risk minimization of Err codemadness.org 70 i 4775 mixup to alleviate over-fitting while improves it by sampling fewer Err codemadness.org 70 i 4776 feature-target vectors around mislabeled data from the mixup vicinal Err codemadness.org 70 i 4777 distribution.} Extensive experiments demonstrate that AFM yields Err codemadness.org 70 i 4778 state-of-the-art results on two challenging real-world noisy datasets: Food101N Err codemadness.org 70 i 4779 and Clothing1M. The code will be available at Err codemadness.org 70 i 4780 https://github.com/kaiwang960112/AFM. Err codemadness.org 70 i 4781

Err codemadness.org 70 i 4782

Autoregressive Asymmetric Linear Gaussian Hidden Markov Models. (arXiv:2010.15604v1 [cs.LG])

In a real life process evolving over time, the relationship between its Err codemadness.org 70 i 4789 relevant variables may change. Therefore, it is advantageous to have different Err codemadness.org 70 i 4790 inference models for each state of the process. Asymmetric hidden Markov models Err codemadness.org 70 i 4791 fulfil this dynamical requirement and provide a framework where the trend of Err codemadness.org 70 i 4792 the process can be expressed as a latent variable. In this paper, we modify Err codemadness.org 70 i 4793 these recent asymmetric hidden Markov models to have an asymmetric Err codemadness.org 70 i 4794 autoregressive component, allowing the model to choose the order of Err codemadness.org 70 i 4795 autoregression that maximizes its penalized likelihood for a given training Err codemadness.org 70 i 4796 set. Additionally, we show how inference, hidden states decoding and parameter Err codemadness.org 70 i 4797 learning must be adapted to fit the proposed model. Finally, we run experiments Err codemadness.org 70 i 4798 with synthetic and real data to show the capabilities of this new model. Err codemadness.org 70 i 4799

Err codemadness.org 70 i 4800

Manifold learning-based feature extraction for structural defect reconstruction. (arXiv:2010.15605v1 [cs.CE])

Data-driven quantitative defect reconstructions using ultrasonic guided waves Err codemadness.org 70 i 4807 has recently demonstrated great potential in the area of non-destructive Err codemadness.org 70 i 4808 testing. In this paper, we develop an efficient deep learning-based defect Err codemadness.org 70 i 4809 reconstruction framework, called NetInv, which recasts the inverse guided wave Err codemadness.org 70 i 4810 scattering problem as a data-driven supervised learning progress that realizes Err codemadness.org 70 i 4811 a mapping between reflection coefficients in wavenumber domain and defect Err codemadness.org 70 i 4812 profiles in the spatial domain. The superiorities of the proposed NetInv over Err codemadness.org 70 i 4813 conventional reconstruction methods for defect reconstruction have been Err codemadness.org 70 i 4814 demonstrated by several examples. Results show that NetInv has the ability to Err codemadness.org 70 i 4815 achieve the higher quality of defect profiles with remarkable efficiency and Err codemadness.org 70 i 4816 provides valuable insight into the development of effective data driven Err codemadness.org 70 i 4817 structural health monitoring and defect reconstruction using machine learning. Err codemadness.org 70 i 4818

Err codemadness.org 70 i 4819

Design and Evaluation of Electric Bus Systems for Metropolitan Cities. (arXiv:2010.15606v1 [cs.CY])

Over the past decade, most of the metropolitan cities across the world have Err codemadness.org 70 i 4826 been witnessing a degrading trend in air quality index. Exhaust emission data Err codemadness.org 70 i 4827 observations show that promotion of public transport could be a potential way Err codemadness.org 70 i 4828 out of this gridlock. Due to environmental concerns, numerous public transport Err codemadness.org 70 i 4829 authorities harbor a great interest in introducing zero emission electric Err codemadness.org 70 i 4830 buses. A shift from conventional diesel buses to electric buses comes with Err codemadness.org 70 i 4831 several benefits in terms of reduction in local pollution, noise, and fuel Err codemadness.org 70 i 4832 consumption. This paper proposes the relevant vehicle technologies, powertrain, Err codemadness.org 70 i 4833 and charging systems, which, in combination, provides a comprehensive Err codemadness.org 70 i 4834 methodology to design an Electric Bus that can be deployed in metropolitan Err codemadness.org 70 i 4835 cities to mitigate emission concerns. Err codemadness.org 70 i 4836

Err codemadness.org 70 i 4837

CRICTRS: Embeddings based Statistical and Semi Supervised Cricket Team Recommendation System. (arXiv:2010.15607v1 [cs.CY])

Team Recommendation has always been a challenging aspect in team sports. Such Err codemadness.org 70 i 4844 systems aim to recommend a player combination best suited against the Err codemadness.org 70 i 4845 opposition players, resulting in an optimal outcome. In this paper, we propose Err codemadness.org 70 i 4846 a semi-supervised statistical approach to build a team recommendation system Err codemadness.org 70 i 4847 for cricket by modelling players into embeddings. To build these embeddings, we Err codemadness.org 70 i 4848 design a qualitative and quantitative rating system which considers the Err codemadness.org 70 i 4849 strength of opposition also for evaluating player performance. The embeddings Err codemadness.org 70 i 4850 obtained, describes the strengths and weaknesses of the players based on past Err codemadness.org 70 i 4851 performances of the player. We also embark on a critical aspect of team Err codemadness.org 70 i 4852 composition, which includes the number of batsmen and bowlers in the team. The Err codemadness.org 70 i 4853 team composition changes over time, depending on different factors which are Err codemadness.org 70 i 4854 tough to predict, so we take this input from the user and use the player Err codemadness.org 70 i 4855 embeddings to decide the best possible team combination with the given team Err codemadness.org 70 i 4856 composition. Err codemadness.org 70 i 4857

Err codemadness.org 70 i 4858

An Overview Of 3D Object Detection. (arXiv:2010.15614v1 [cs.CV])

Point cloud 3D object detection has recently received major attention and Err codemadness.org 70 i 4865 becomes an active research topic in 3D computer vision community. However, Err codemadness.org 70 i 4866 recognizing 3D objects in LiDAR (Light Detection and Ranging) is still a Err codemadness.org 70 i 4867 challenge due to the complexity of point clouds. Objects such as pedestrians, Err codemadness.org 70 i 4868 cyclists, or traffic cones are usually represented by quite sparse points, Err codemadness.org 70 i 4869 which makes the detection quite complex using only point cloud. In this Err codemadness.org 70 i 4870 project, we propose a framework that uses both RGB and point cloud data to Err codemadness.org 70 i 4871 perform multiclass object recognition. We use existing 2D detection models to Err codemadness.org 70 i 4872 localize the region of interest (ROI) on the RGB image, followed by a pixel Err codemadness.org 70 i 4873 mapping strategy in the point cloud, and finally, lift the initial 2D bounding Err codemadness.org 70 i 4874 box to 3D space. We use the recently released nuScenes dataset---a large-scale Err codemadness.org 70 i 4875 dataset contains many data formats---to training and evaluate our proposed Err codemadness.org 70 i 4876 architecture. Err codemadness.org 70 i 4877

Err codemadness.org 70 i 4878

Sampling and Reconstruction of Sparse Signals in Shift-Invariant Spaces: Generalized Shannon's Theorem Meets Compressive Sensing. (arXiv:2010.15618v1 [eess.SP])

This paper introduces a novel framework and corresponding methods for Err codemadness.org 70 i 4885 sampling and reconstruction of sparse signals in shift-invariant (SI) spaces. Err codemadness.org 70 i 4886 We reinterpret the random demodulator, a system that acquires sparse Err codemadness.org 70 i 4887 bandlimited signals, as a system for acquisition of linear combinations of the Err codemadness.org 70 i 4888 samples in the SI setting with the box function as the sampling kernel. The Err codemadness.org 70 i 4889 sparsity assumption is exploited by compressive sensing (CS) framework for Err codemadness.org 70 i 4890 recovery of the SI samples from a reduced set of measurements. The samples are Err codemadness.org 70 i 4891 subsequently filtered by a discrete-time correction filter in order to Err codemadness.org 70 i 4892 reconstruct expansion coefficients of an observed signal. Furthermore, we offer Err codemadness.org 70 i 4893 a generalization of the proposed framework to other sampling kernels that lie Err codemadness.org 70 i 4894 in arbitrary SI spaces. The generalized method embeds the correction filter in Err codemadness.org 70 i 4895 a CS optimization problem which directly reconstructs expansion coefficients of Err codemadness.org 70 i 4896 the signal. Both approaches recast an inherently infinite-dimensional inverse Err codemadness.org 70 i 4897 problem as a finite-dimensional CS problem in an exact way. Finally, we conduct Err codemadness.org 70 i 4898 numerical experiments on signals in B-spline spaces whose expansion Err codemadness.org 70 i 4899 coefficients are assumed to be sparse in a certain transform domain. The Err codemadness.org 70 i 4900 coefficients can be regarded as parametric models of an underlying continuous Err codemadness.org 70 i 4901 signal, obtained from a reduced set of measurements. Such continuous signal Err codemadness.org 70 i 4902 representations are particularly suitable for signal processing without Err codemadness.org 70 i 4903 converting them into samples. Err codemadness.org 70 i 4904

Err codemadness.org 70 i 4905

CAFE: Coarse-to-Fine Neural Symbolic Reasoning for Explainable Recommendation. (arXiv:2010.15620v1 [cs.IR])

Recent research explores incorporating knowledge graphs (KG) into e-commerce Err codemadness.org 70 i 4912 recommender systems, not only to achieve better recommendation performance, but Err codemadness.org 70 i 4913 more importantly to generate explanations of why particular decisions are made. Err codemadness.org 70 i 4914 This can be achieved by explicit KG reasoning, where a model starts from a user Err codemadness.org 70 i 4915 node, sequentially determines the next step, and walks towards an item node of Err codemadness.org 70 i 4916 potential interest to the user. However, this is challenging due to the huge Err codemadness.org 70 i 4917 search space, unknown destination, and sparse signals over the KG, so Err codemadness.org 70 i 4918 informative and effective guidance is needed to achieve a satisfactory Err codemadness.org 70 i 4919 recommendation quality. To this end, we propose a CoArse-to-FinE neural Err codemadness.org 70 i 4920 symbolic reasoning approach (CAFE). It first generates user profiles as coarse Err codemadness.org 70 i 4921 sketches of user behaviors, which subsequently guide a path-finding process to Err codemadness.org 70 i 4922 derive reasoning paths for recommendations as fine-grained predictions. User Err codemadness.org 70 i 4923 profiles can capture prominent user behaviors from the history, and provide Err codemadness.org 70 i 4924 valuable signals about which kinds of path patterns are more likely to lead to Err codemadness.org 70 i 4925 potential items of interest for the user. To better exploit the user profiles, Err codemadness.org 70 i 4926 an improved path-finding algorithm called Profile-guided Path Reasoning (PPR) Err codemadness.org 70 i 4927 is also developed, which leverages an inventory of neural symbolic reasoning Err codemadness.org 70 i 4928 modules to effectively and efficiently find a batch of paths over a large-scale Err codemadness.org 70 i 4929 KG. We extensively experiment on four real-world benchmarks and observe Err codemadness.org 70 i 4930 substantial gains in the recommendation performance compared with Err codemadness.org 70 i 4931 state-of-the-art methods. Err codemadness.org 70 i 4932

Err codemadness.org 70 i 4933

Low-Variance Policy Gradient Estimation with World Models. (arXiv:2010.15622v1 [stat.ML])

In this paper, we propose World Model Policy Gradient (WMPG), an approach to Err codemadness.org 70 i 4940 reduce the variance of policy gradient estimates using learned world models Err codemadness.org 70 i 4941 (WM's). In WMPG, a WM is trained online and used to imagine trajectories. The Err codemadness.org 70 i 4942 imagined trajectories are used in two ways. Firstly, to calculate a Err codemadness.org 70 i 4943 without-replacement estimator of the policy gradient. Secondly, the return of Err codemadness.org 70 i 4944 the imagined trajectories is used as an informed baseline. We compare the Err codemadness.org 70 i 4945 proposed approach with AC and MAC on a set of environments of increasing Err codemadness.org 70 i 4946 complexity (CartPole, LunarLander and Pong) and find that WMPG has better Err codemadness.org 70 i 4947 sample efficiency. Based on these results, we conclude that WMPG can yield Err codemadness.org 70 i 4948 increased sample efficiency in cases where a robust latent representation of Err codemadness.org 70 i 4949 the environment can be learned. Err codemadness.org 70 i 4950

Err codemadness.org 70 i 4951

Fast Minimal Presentations of Bi-graded Persistence Modules. (arXiv:2010.15623v1 [math.AT])

Multi-parameter persistent homology is a recent branch of topological data Err codemadness.org 70 i 4958 analysis. In this area, data sets are investigated through the lens of homology Err codemadness.org 70 i 4959 with respect to two or more scale parameters. The high computational cost of Err codemadness.org 70 i 4960 many algorithms calls for a preprocessing step to reduce the input size. In Err codemadness.org 70 i 4961 general, a minimal presentation is the smallest possible representation of a Err codemadness.org 70 i 4962 persistence module. Lesnick and Wright proposed recently an algorithm (the Err codemadness.org 70 i 4963 LW-algorithm) for computing minimal presentations based on matrix reduction. In Err codemadness.org 70 i 4964 this work, we propose, implement and benchmark several improvements over the Err codemadness.org 70 i 4965 LW-algorithm. Most notably, we propose the use of priority queues to avoid Err codemadness.org 70 i 4966 extensive scanning of the matrix columns, which constitutes the computational Err codemadness.org 70 i 4967 bottleneck in the LW-algorithm, and we combine their algorithm with ideas from Err codemadness.org 70 i 4968 the multi-parameter chunk algorithm by Fugacci and Kerber. Our extensive Err codemadness.org 70 i 4969 experiments show that our algorithm outperforms the LW-algorithm and computes Err codemadness.org 70 i 4970 the minimal presentation for data sets with millions of simplices within a few Err codemadness.org 70 i 4971 seconds. Our software is publicly available. Err codemadness.org 70 i 4972

Err codemadness.org 70 i 4973

Abstract Value Iteration for Hierarchical Reinforcement Learning. (arXiv:2010.15638v1 [cs.LG])

We propose a novel hierarchical reinforcement learning framework for control Err codemadness.org 70 i 4980 with continuous state and action spaces. In our framework, the user specifies Err codemadness.org 70 i 4981 subgoal regions which are subsets of states; then, we (i) learn options that Err codemadness.org 70 i 4982 serve as transitions between these subgoal regions, and (ii) construct a Err codemadness.org 70 i 4983 high-level plan in the resulting abstract decision process (ADP). A key Err codemadness.org 70 i 4984 challenge is that the ADP may not be Markov, which we address by proposing two Err codemadness.org 70 i 4985 algorithms for planning in the ADP. Our first algorithm is conservative, Err codemadness.org 70 i 4986 allowing us to prove theoretical guarantees on its performance, which help Err codemadness.org 70 i 4987 inform the design of subgoal regions. Our second algorithm is a practical one Err codemadness.org 70 i 4988 that interweaves planning at the abstract level and learning at the concrete Err codemadness.org 70 i 4989 level. In our experiments, we demonstrate that our approach outperforms Err codemadness.org 70 i 4990 state-of-the-art hierarchical reinforcement learning algorithms on several Err codemadness.org 70 i 4991 challenging benchmarks. Err codemadness.org 70 i 4992

Err codemadness.org 70 i 4993

Teaching a GAN What Not to Learn. (arXiv:2010.15639v1 [stat.ML])

Generative adversarial networks (GANs) were originally envisioned as Err codemadness.org 70 i 5000 unsupervised generative models that learn to follow a target distribution. Err codemadness.org 70 i 5001 Variants such as conditional GANs, auxiliary-classifier GANs (ACGANs) project Err codemadness.org 70 i 5002 GANs on to supervised and semi-supervised learning frameworks by providing Err codemadness.org 70 i 5003 labelled data and using multi-class discriminators. In this paper, we approach Err codemadness.org 70 i 5004 the supervised GAN problem from a different perspective, one that is motivated Err codemadness.org 70 i 5005 by the philosophy of the famous Persian poet Rumi who said, "The art of knowing Err codemadness.org 70 i 5006 is knowing what to ignore." In the GAN framework, we not only provide the GAN Err codemadness.org 70 i 5007 positive data that it must learn to model, but also present it with so-called Err codemadness.org 70 i 5008 negative samples that it must learn to avoid - we call this "The Rumi Err codemadness.org 70 i 5009 Framework." This formulation allows the discriminator to represent the Err codemadness.org 70 i 5010 underlying target distribution better by learning to penalize generated samples Err codemadness.org 70 i 5011 that are undesirable - we show that this capability accelerates the learning Err codemadness.org 70 i 5012 process of the generator. We present a reformulation of the standard GAN (SGAN) Err codemadness.org 70 i 5013 and least-squares GAN (LSGAN) within the Rumi setting. The advantage of the Err codemadness.org 70 i 5014 reformulation is demonstrated by means of experiments conducted on MNIST, Err codemadness.org 70 i 5015 Fashion MNIST, CelebA, and CIFAR-10 datasets. Finally, we consider an Err codemadness.org 70 i 5016 application of the proposed formulation to address the important problem of Err codemadness.org 70 i 5017 learning an under-represented class in an unbalanced dataset. The Rumi approach Err codemadness.org 70 i 5018 results in substantially lower FID scores than the standard GAN frameworks Err codemadness.org 70 i 5019 while possessing better generalization capability. Err codemadness.org 70 i 5020

Err codemadness.org 70 i 5021

Free-Form Image Inpainting via Contrastive Attention Network. (arXiv:2010.15643v1 [cs.CV])

Most deep learning based image inpainting approaches adopt autoencoder or its Err codemadness.org 70 i 5028 variants to fill missing regions in images. Encoders are usually utilized to Err codemadness.org 70 i 5029 learn powerful representational spaces, which are important for dealing with Err codemadness.org 70 i 5030 sophisticated learning tasks. Specifically, in image inpainting tasks, masks Err codemadness.org 70 i 5031 with any shapes can appear anywhere in images (i.e., free-form masks) which Err codemadness.org 70 i 5032 form complex patterns. It is difficult for encoders to capture such powerful Err codemadness.org 70 i 5033 representations under this complex situation. To tackle this problem, we Err codemadness.org 70 i 5034 propose a self-supervised Siamese inference network to improve the robustness Err codemadness.org 70 i 5035 and generalization. It can encode contextual semantics from full resolution Err codemadness.org 70 i 5036 images and obtain more discriminative representations. we further propose a Err codemadness.org 70 i 5037 multi-scale decoder with a novel dual attention fusion module (DAF), which can Err codemadness.org 70 i 5038 combine both the restored and known regions in a smooth way. This multi-scale Err codemadness.org 70 i 5039 architecture is beneficial for decoding discriminative representations learned Err codemadness.org 70 i 5040 by encoders into images layer by layer. In this way, unknown regions will be Err codemadness.org 70 i 5041 filled naturally from outside to inside. Qualitative and quantitative Err codemadness.org 70 i 5042 experiments on multiple datasets, including facial and natural datasets (i.e., Err codemadness.org 70 i 5043 Celeb-HQ, Pairs Street View, Places2 and ImageNet), demonstrate that our Err codemadness.org 70 i 5044 proposed method outperforms state-of-the-art methods in generating high-quality Err codemadness.org 70 i 5045 inpainting results. Err codemadness.org 70 i 5046

Err codemadness.org 70 i 5047

Brain Tumor Segmentation Network Using Attention-based Fusion and Spatial Relationship Constraint. (arXiv:2010.15647v1 [eess.IV])

Delineating the brain tumor from magnetic resonance (MR) images is critical Err codemadness.org 70 i 5054 for the treatment of gliomas. However, automatic delineation is challenging due Err codemadness.org 70 i 5055 to the complex appearance and ambiguous outlines of tumors. Considering that Err codemadness.org 70 i 5056 multi-modal MR images can reflect different tumor biological properties, we Err codemadness.org 70 i 5057 develop a novel multi-modal tumor segmentation network (MMTSN) to robustly Err codemadness.org 70 i 5058 segment brain tumors based on multi-modal MR images. The MMTSN is composed of Err codemadness.org 70 i 5059 three sub-branches and a main branch. Specifically, the sub-branches are used Err codemadness.org 70 i 5060 to capture different tumor features from multi-modal images, while in the main Err codemadness.org 70 i 5061 branch, we design a spatial-channel fusion block (SCFB) to effectively Err codemadness.org 70 i 5062 aggregate multi-modal features. Additionally, inspired by the fact that the Err codemadness.org 70 i 5063 spatial relationship between sub-regions of tumor is relatively fixed, e.g., Err codemadness.org 70 i 5064 the enhancing tumor is always in the tumor core, we propose a spatial loss to Err codemadness.org 70 i 5065 constrain the relationship between different sub-regions of tumor. We evaluate Err codemadness.org 70 i 5066 our method on the test set of multi-modal brain tumor segmentation challenge Err codemadness.org 70 i 5067 2020 (BraTs2020). The method achieves 0.8764, 0.8243 and 0.773 dice score for Err codemadness.org 70 i 5068 whole tumor, tumor core and enhancing tumor, respectively. Err codemadness.org 70 i 5069

Err codemadness.org 70 i 5070

Reliable Graph Neural Networks via Robust Aggregation. (arXiv:2010.15651v1 [cs.LG])

Perturbations targeting the graph structure have proven to be extremely Err codemadness.org 70 i 5077 effective in reducing the performance of Graph Neural Networks (GNNs), and Err codemadness.org 70 i 5078 traditional defenses such as adversarial training do not seem to be able to Err codemadness.org 70 i 5079 improve robustness. This work is motivated by the observation that Err codemadness.org 70 i 5080 adversarially injected edges effectively can be viewed as additional samples to Err codemadness.org 70 i 5081 a node's neighborhood aggregation function, which results in distorted Err codemadness.org 70 i 5082 aggregations accumulating over the layers. Conventional GNN aggregation Err codemadness.org 70 i 5083 functions, such as a sum or mean, can be distorted arbitrarily by a single Err codemadness.org 70 i 5084 outlier. We propose a robust aggregation function motivated by the field of Err codemadness.org 70 i 5085 robust statistics. Our approach exhibits the largest possible breakdown point Err codemadness.org 70 i 5086 of 0.5, which means that the bias of the aggregation is bounded as long as the Err codemadness.org 70 i 5087 fraction of adversarial edges of a node is less than 50\%. Our novel Err codemadness.org 70 i 5088 aggregation function, Soft Medoid, is a fully differentiable generalization of Err codemadness.org 70 i 5089 the Medoid and therefore lends itself well for end-to-end deep learning. Err codemadness.org 70 i 5090 Equipping a GNN with our aggregation improves the robustness with respect to Err codemadness.org 70 i 5091 structure perturbations on Cora ML by a factor of 3 (and 5.5 on Citeseer) and Err codemadness.org 70 i 5092 by a factor of 8 for low-degree nodes. Err codemadness.org 70 i 5093

Err codemadness.org 70 i 5094

Semi-Supervised Speech Recognition via Graph-based Temporal Classification. (arXiv:2010.15653v1 [cs.LG])

Semi-supervised learning has demonstrated promising results in automatic Err codemadness.org 70 i 5101 speech recognition (ASR) by self-training using a seed ASR model with Err codemadness.org 70 i 5102 pseudo-labels generated for unlabeled data. The effectiveness of this approach Err codemadness.org 70 i 5103 largely relies on the pseudo-label accuracy, for which typically only the Err codemadness.org 70 i 5104 1-best ASR hypothesis is used. However, alternative ASR hypotheses of an N-best Err codemadness.org 70 i 5105 list can provide more accurate labels for an unlabeled speech utterance and Err codemadness.org 70 i 5106 also reflect uncertainties of the seed ASR model. In this paper, we propose a Err codemadness.org 70 i 5107 generalized form of the connectionist temporal classification (CTC) objective Err codemadness.org 70 i 5108 that accepts a graph representation of the training targets. The newly proposed Err codemadness.org 70 i 5109 graph-based temporal classification (GTC) objective is applied for Err codemadness.org 70 i 5110 self-training with WFST-based supervision, which is generated from an N-best Err codemadness.org 70 i 5111 list of pseudo-labels. In this setup, GTC is used to learn not only a temporal Err codemadness.org 70 i 5112 alignment, similarly to CTC, but also a label alignment to obtain the optimal Err codemadness.org 70 i 5113 pseudo-label sequence from the weighted graph. Results show that this approach Err codemadness.org 70 i 5114 can effectively exploit an N-best list of pseudo-labels with associated scores, Err codemadness.org 70 i 5115 outperforming standard pseudo-labeling by a large margin, with ASR results Err codemadness.org 70 i 5116 close to an oracle experiment in which the best hypotheses of the N-best lists Err codemadness.org 70 i 5117 are selected manually. Err codemadness.org 70 i 5118

Err codemadness.org 70 i 5119

Identification of complex mixtures for Raman spectroscopy using a novel scheme based on a new multi-label deep neural network. (arXiv:2010.15654v1 [eess.SP])

With noisy environment caused by fluoresence and additive white noise as well Err codemadness.org 70 i 5126 as complicated spectrum fingerprints, the identification of complex mixture Err codemadness.org 70 i 5127 materials remains a major challenge in Raman spectroscopy application. In this Err codemadness.org 70 i 5128 paper, we propose a new scheme based on a constant wavelet transform (CWT) and Err codemadness.org 70 i 5129 a deep network for classifying complex mixture. The scheme first transforms the Err codemadness.org 70 i 5130 noisy Raman spectrum to a two-dimensional scale map using CWT. A multi-label Err codemadness.org 70 i 5131 deep neural network model (MDNN) is then applied for classifying material. The Err codemadness.org 70 i 5132 proposed model accelerates the feature extraction and expands the feature graph Err codemadness.org 70 i 5133 using the global averaging pooling layer. The Sigmoid function is implemented Err codemadness.org 70 i 5134 in the last layer of the model. The MDNN model was trained, validated and Err codemadness.org 70 i 5135 tested with data collected from the samples prepared from substances in palm Err codemadness.org 70 i 5136 oil. During training and validating process, data augmentation is applied to Err codemadness.org 70 i 5137 overcome the imbalance of data and enrich the diversity of Raman spectra. From Err codemadness.org 70 i 5138 the test results, it is found that the MDNN model outperforms previously Err codemadness.org 70 i 5139 proposed deep neural network models in terms of Hamming loss, one error, Err codemadness.org 70 i 5140 coverage, ranking loss, average precision, F1 macro averaging and F1 micro Err codemadness.org 70 i 5141 averaging, respectively. The average detection time obtained from our model is Err codemadness.org 70 i 5142 5.31 s, which is much faster than the detection time of the previously proposed Err codemadness.org 70 i 5143 models. Err codemadness.org 70 i 5144

Err codemadness.org 70 i 5145

Generalization bounds for deep thresholding networks. (arXiv:2010.15658v1 [math.ST])

We consider compressive sensing in the scenario where the sparsity basis Err codemadness.org 70 i 5152 (dictionary) is not known in advance, but needs to be learned from examples. Err codemadness.org 70 i 5153 Motivated by the well-known iterative soft thresholding algorithm for the Err codemadness.org 70 i 5154 reconstruction, we define deep networks parametrized by the dictionary, which Err codemadness.org 70 i 5155 we call deep thresholding networks. Based on training samples, we aim at Err codemadness.org 70 i 5156 learning the optimal sparsifying dictionary and thereby the optimal network Err codemadness.org 70 i 5157 that reconstructs signals from their low-dimensional linear measurements. The Err codemadness.org 70 i 5158 dictionary learning is performed via minimizing the empirical risk. We derive Err codemadness.org 70 i 5159 generalization bounds by analyzing the Rademacher complexity of hypothesis Err codemadness.org 70 i 5160 classes consisting of such deep networks. We obtain estimates of the sample Err codemadness.org 70 i 5161 complexity that depend only linearly on the dimensions and on the depth. Err codemadness.org 70 i 5162

Err codemadness.org 70 i 5163

Independence Tests Without Ground Truth for Noisy Learners. (arXiv:2010.15662v1 [stat.ML])

Exact ground truth invariant polynomial systems can be written for Err codemadness.org 70 i 5170 arbitrarily correlated binary classifiers. Their solutions give estimates for Err codemadness.org 70 i 5171 sample statistics that require knowledge of the ground truth of the correct Err codemadness.org 70 i 5172 labels in the sample. Of these polynomial systems, only a few have been solved Err codemadness.org 70 i 5173 in closed form. Here we discuss the exact solution for independent binary Err codemadness.org 70 i 5174 classifiers - resolving an outstanding problem that has been presented at this Err codemadness.org 70 i 5175 conference and others. Its practical applicability is hampered by its sole Err codemadness.org 70 i 5176 remaining assumption - the classifiers need to be independent in their sample Err codemadness.org 70 i 5177 errors. We discuss how to use the closed form solution to create a Err codemadness.org 70 i 5178 self-consistent test that can validate the independence assumption itself Err codemadness.org 70 i 5179 absent the correct labels ground truth. It can be cast as an algebraic geometry Err codemadness.org 70 i 5180 conjecture for binary classifiers that remains unsolved. A similar conjecture Err codemadness.org 70 i 5181 for the ground truth invariant algebraic system for scalar regressors is Err codemadness.org 70 i 5182 solvable, and we present the solution here. We also discuss experiments on the Err codemadness.org 70 i 5183 Penn ML Benchmark classification tasks that provide further evidence that the Err codemadness.org 70 i 5184 conjecture may be true for the polynomial system of binary classifiers. Err codemadness.org 70 i 5185

Err codemadness.org 70 i 5186

Machine Ethics and Automated Vehicles. (arXiv:2010.15665v1 [cs.CY])

Road vehicle travel at a reasonable speed involves some risk, even when using Err codemadness.org 70 i 5193 computer-controlled driving with failure-free hardware and perfect sensing. A Err codemadness.org 70 i 5194 fully-automated vehicle must continuously decide how to allocate this risk Err codemadness.org 70 i 5195 without a human driver's oversight. These are ethical decisions, particularly Err codemadness.org 70 i 5196 in instances where an automated vehicle cannot avoid crashing. In this chapter, Err codemadness.org 70 i 5197 I introduce the concept of moral behavior for an automated vehicle, argue the Err codemadness.org 70 i 5198 need for research in this area through responses to anticipated critiques, and Err codemadness.org 70 i 5199 discuss relevant applications from machine ethics and moral modeling research. Err codemadness.org 70 i 5200

Err codemadness.org 70 i 5201

PeopleXploit -- A hybrid tool to collect public data. (arXiv:2010.15668v1 [cs.CY])

This paper introduces the concept of Open Source Intelligence (OSINT) as an Err codemadness.org 70 i 5208 important application in intelligent profiling of individuals. With a variety Err codemadness.org 70 i 5209 of tools available, significant data shall be obtained on an individual as a Err codemadness.org 70 i 5210 consequence of analyzing his/her internet presence but all of this comes at the Err codemadness.org 70 i 5211 cost of low relevance. To increase the relevance score in profiling, Err codemadness.org 70 i 5212 PeopleXploit is being introduced. PeopleXploit is a hybrid tool which helps in Err codemadness.org 70 i 5213 collecting the publicly available information that is reliable and relevant to Err codemadness.org 70 i 5214 the given input. This tool is used to track and trace the given target with Err codemadness.org 70 i 5215 their digital footprints like Name, Email, Phone Number, User IDs etc. and the Err codemadness.org 70 i 5216 tool will scan & search other associated data from public available records Err codemadness.org 70 i 5217 from the internet and create a summary report against the target. PeopleXploit Err codemadness.org 70 i 5218 profiles a person using authorship analysis and finds the best matching guess. Err codemadness.org 70 i 5219 Also, the type of analysis performed (professional/matrimonial/criminal entity) Err codemadness.org 70 i 5220 varies with the requirement of the user. Err codemadness.org 70 i 5221

Err codemadness.org 70 i 5222

Using Twitter to Analyze Political Polarization During National Crises. (arXiv:2010.15669v1 [cs.CY])

Democrats and Republicans have seemed to grow apart in the past three Err codemadness.org 70 i 5229 decades. Since the United States as we know it today is undeniably bipartisan, Err codemadness.org 70 i 5230 this phenomenon would not appear as a surprise to most. However, there are Err codemadness.org 70 i 5231 triggers which can cause spikes in disagreements between Democrats and Err codemadness.org 70 i 5232 Republicans at a higher rate than how the two parties have been growing apart Err codemadness.org 70 i 5233 gradually over time. This study has analyzed the idea that national events Err codemadness.org 70 i 5234 which generally are detrimental to all individuals can be one of those Err codemadness.org 70 i 5235 triggers. By testing polarization before and after three events (Hurricane Err codemadness.org 70 i 5236 Sandy [2012], N. Korea Missile Test Surge [2019], COVID-19 [2020]) using Err codemadness.org 70 i 5237 Twitter data, we show that a measurable spike in polarization occurs between Err codemadness.org 70 i 5238 the Democrat and Republican party. In order to measure polarization, sentiments Err codemadness.org 70 i 5239 of Twitter users aligned to the Democrat and Republican parties are compared on Err codemadness.org 70 i 5240 identical entities (events, people, locations, etc.). Using hundreds of Err codemadness.org 70 i 5241 thousands of data samples, a 2.8% increase in polarization was measured during Err codemadness.org 70 i 5242 times of crisis compared to times where no crises were occurring. Regardless of Err codemadness.org 70 i 5243 the reasoning that the gap between political parties can increase so much Err codemadness.org 70 i 5244 during times of suffering and stress, it is definitely alarming to see that Err codemadness.org 70 i 5245 among other aspects of life, the partisan gap worsens during detrimental Err codemadness.org 70 i 5246 national events. Err codemadness.org 70 i 5247

Err codemadness.org 70 i 5248

Detecting Individuals with Depressive Disorder fromPersonal Google Search and YouTube History Logs. (arXiv:2010.15670v1 [cs.CY])

Depressive disorder is one of the most prevalent mental illnesses among the Err codemadness.org 70 i 5255 global population. However, traditional screening methods require exacting Err codemadness.org 70 i 5256 in-person interviews and may fail to provide immediate interventions. In this Err codemadness.org 70 i 5257 work, we leverage ubiquitous personal longitudinal Google Search and YouTube Err codemadness.org 70 i 5258 engagement logs to detect individuals with depressive disorder. We collected Err codemadness.org 70 i 5259 Google Search and YouTube history data and clinical depression evaluation Err codemadness.org 70 i 5260 results from $212$ participants ($99$ of them suffered from moderate to severe Err codemadness.org 70 i 5261 depressions). We then propose a personalized framework for classifying Err codemadness.org 70 i 5262 individuals with and without depression symptoms based on mutual-exciting point Err codemadness.org 70 i 5263 process that captures both the temporal and semantic aspects of online Err codemadness.org 70 i 5264 activities. Our best model achieved an average F1 score of $0.77 \pm 0.04$ and Err codemadness.org 70 i 5265 an AUC ROC of $0.81 \pm 0.02$. Err codemadness.org 70 i 5266

Err codemadness.org 70 i 5267

Computing Crisp Bisimulations for Fuzzy Structures. (arXiv:2010.15671v1 [cs.DS])

Fuzzy structures such as fuzzy automata, fuzzy transition systems, weighted Err codemadness.org 70 i 5274 social networks and fuzzy interpretations in fuzzy description logics have been Err codemadness.org 70 i 5275 widely studied. For such structures, bisimulation is a natural notion for Err codemadness.org 70 i 5276 characterizing indiscernibility between states or individuals. There are two Err codemadness.org 70 i 5277 kinds of bisimulations for fuzzy structures: crisp bisimulations and fuzzy Err codemadness.org 70 i 5278 bisimulations. While the latter fits to the fuzzy paradigm, the former has also Err codemadness.org 70 i 5279 attracted attention due to the application of crisp equivalence relations, for Err codemadness.org 70 i 5280 example, in minimizing structures. Bisimulations can be formulated for fuzzy Err codemadness.org 70 i 5281 labeled graphs and then adapted to other fuzzy structures. In this article, we Err codemadness.org 70 i 5282 present an efficient algorithm for computing the partition corresponding to the Err codemadness.org 70 i 5283 largest crisp bisimulation of a given finite fuzzy labeled graph. Its Err codemadness.org 70 i 5284 complexity is of order $O((m\log{l} + n)\log{n})$, where $n$, $m$ and $l$ are Err codemadness.org 70 i 5285 the number of vertices, the number of nonzero edges and the number of different Err codemadness.org 70 i 5286 fuzzy degrees of edges of the input graph, respectively. We also study a Err codemadness.org 70 i 5287 similar problem for the setting with counting successors, which corresponds to Err codemadness.org 70 i 5288 the case with qualified number restrictions in description logics and graded Err codemadness.org 70 i 5289 modalities in modal logics. In particular, we provide an efficient algorithm Err codemadness.org 70 i 5290 with the complexity $O((m\log{m} + n)\log{n})$ for the considered problem in Err codemadness.org 70 i 5291 that setting. Err codemadness.org 70 i 5292

Err codemadness.org 70 i 5293

FD Cell-Free mMIMO: Analysis and Optimization. (arXiv:2010.15672v1 [eess.SP])

We consider a full-duplex cell-free massive multiple-input-multiple-output Err codemadness.org 70 i 5300 system with limited capacity fronthaul links. We derive its downlink/uplink Err codemadness.org 70 i 5301 closed-form spectral efficiency (SE) lower bounds with maximum-ratio Err codemadness.org 70 i 5302 transmission/maximum-ratio combining and optimal uniform quantization. To Err codemadness.org 70 i 5303 reduce carbon footprint, this paper maximizes the non-convex weighted sum Err codemadness.org 70 i 5304 energy efficiency (WSEE) via downlink and uplink power control, and successive Err codemadness.org 70 i 5305 convex approximation framework. We show that with low fronthaul capacity, the Err codemadness.org 70 i 5306 system requires a higher number of fronthaul quantization bits to achieve high Err codemadness.org 70 i 5307 SE and WSEE. For high fronthaul capacity, higher number of bits, however, Err codemadness.org 70 i 5308 achieves high SE but a reduced WSEE. Err codemadness.org 70 i 5309

Err codemadness.org 70 i 5310

Machine Learning Based Demand Modelling for On-Demand Transit Services: A Case Study of Belleville, Ontario. (arXiv:2010.15673v1 [cs.CY])

The use of mobile applications apps and GPS service on smartphones for Err codemadness.org 70 i 5317 transportation management applications has enabled the new "on-demand mobility" Err codemadness.org 70 i 5318 service, where the transportation supply is following the users' schedule and Err codemadness.org 70 i 5319 routes. In September 2018, the City of Belleville in Canada and Pantonium Err codemadness.org 70 i 5320 operationalized the same idea, but for the public transit service in the city Err codemadness.org 70 i 5321 to develop an on-demand transit (ODT) service. An existing fixed route (RT 11) Err codemadness.org 70 i 5322 public transit service was converted into an on-demand service during the night Err codemadness.org 70 i 5323 as a pilot project to maintain a higher demand sensitivity and highest Err codemadness.org 70 i 5324 operation cost efficiency per trip. In this study, Random Forest (RF), Bagging, Err codemadness.org 70 i 5325 Artificial Neural Network (ANN), and Deep Neural Network (DNN) machine learning Err codemadness.org 70 i 5326 algorithms were adopted to develop a pickup demand model (trip generation) and Err codemadness.org 70 i 5327 a trip demand model (trip distribution model) for Belleville ODT service based Err codemadness.org 70 i 5328 on the dissemination areas' demographic characteristics and the existing trip Err codemadness.org 70 i 5329 characteristics. The developed models aim to explain the demand behavior, Err codemadness.org 70 i 5330 investigate the main factors affecting the trip pattern and their relative Err codemadness.org 70 i 5331 importance, and to predict the number of generated trips from any dissemination Err codemadness.org 70 i 5332 area as well as between any two dissemination areas. The results indicate that Err codemadness.org 70 i 5333 the developed models can predict 63% and 70% of the pickup and trip demand Err codemadness.org 70 i 5334 levels, respectively. Both models are most affected by the month of the year Err codemadness.org 70 i 5335 and the day of the week variables. In addition, the population density has a Err codemadness.org 70 i 5336 higher impact on the ODT service pickup demand levels than the other Err codemadness.org 70 i 5337 demographic characteristics followed by the working age percentages and median Err codemadness.org 70 i 5338 income characteristics. Whereas, the distribution of the trips depends on the Err codemadness.org 70 i 5339 demographic characteristics of the destination area more than the origin area. Err codemadness.org 70 i 5340

Err codemadness.org 70 i 5341

Analyzing Societal Impact of COVID-19: A Study During the Early Days of the Pandemic. (arXiv:2010.15674v1 [cs.SI])

In this paper, we collect and study Twitter communications to understand the Err codemadness.org 70 i 5348 societal impact of COVID-19 in the United States during the early days of the Err codemadness.org 70 i 5349 pandemic. With infections soaring rapidly, users took to Twitter asking people Err codemadness.org 70 i 5350 to self isolate and quarantine themselves. Users also demanded closure of Err codemadness.org 70 i 5351 schools, bars, and restaurants as well as lockdown of cities and states. We Err codemadness.org 70 i 5352 methodically collect tweets by identifying and tracking trending COVID-related Err codemadness.org 70 i 5353 hashtags. We first manually group the hashtags into six main categories, Err codemadness.org 70 i 5354 namely, 1) General COVID, 2) Quarantine, 3) Panic Buying, 4) School Closures, Err codemadness.org 70 i 5355 5) Lockdowns, and 6) Frustration and Hope}, and study the temporal evolution of Err codemadness.org 70 i 5356 tweets in these hashtags. We conduct a linguistic analysis of words common to Err codemadness.org 70 i 5357 all hashtag groups and specific to each hashtag group and identify the chief Err codemadness.org 70 i 5358 concerns of people as the pandemic gripped the nation (e.g., exploring bidets Err codemadness.org 70 i 5359 as an alternative to toilet paper). We conduct sentiment analysis and our Err codemadness.org 70 i 5360 investigation reveals that people reacted positively to school closures and Err codemadness.org 70 i 5361 negatively to the lack of availability of essential goods due to panic buying. Err codemadness.org 70 i 5362 We adopt a state-of-the-art semantic role labeling approach to identify the Err codemadness.org 70 i 5363 action words and then leverage a LSTM-based dependency parsing model to analyze Err codemadness.org 70 i 5364 the context of action words (e.g., verb deal is accompanied by nouns such as Err codemadness.org 70 i 5365 anxiety, stress, and crisis). Finally, we develop a scalable seeded topic Err codemadness.org 70 i 5366 modeling approach to automatically categorize and isolate tweets into hashtag Err codemadness.org 70 i 5367 groups and experimentally validate that our topic model provides a grouping Err codemadness.org 70 i 5368 similar to our manual grouping. Our study presents a systematic way to Err codemadness.org 70 i 5369 construct an aggregated picture of peoples' response to the pandemic and lays Err codemadness.org 70 i 5370 the groundwork for future fine-grained linguistic and behavioral analysis. Err codemadness.org 70 i 5371

Err codemadness.org 70 i 5372

Deep DA for Ordinal Regression of Pain Intensity Estimation Using Weakly-Labeled Videos. (arXiv:2010.15675v1 [cs.CV])

Automatic estimation of pain intensity from facial expressions in videos has Err codemadness.org 70 i 5379 an immense potential in health care applications. However, domain adaptation Err codemadness.org 70 i 5380 (DA) is needed to alleviate the problem of domain shifts that typically occurs Err codemadness.org 70 i 5381 between video data captured in source and target do-mains. Given the laborious Err codemadness.org 70 i 5382 task of collecting and annotating videos, and the subjective bias due to Err codemadness.org 70 i 5383 ambiguity among adjacent intensity levels, weakly-supervised learning (WSL)is Err codemadness.org 70 i 5384 gaining attention in such applications. Yet, most state-of-the-art WSL models Err codemadness.org 70 i 5385 are typically formulated as regression problems, and do not leverage the Err codemadness.org 70 i 5386 ordinal relation between intensity levels, nor the temporal coherence of Err codemadness.org 70 i 5387 multiple consecutive frames. This paper introduces a new deep learn-ing model Err codemadness.org 70 i 5388 for weakly-supervised DA with ordinal regression(WSDA-OR), where videos in Err codemadness.org 70 i 5389 target domain have coarse la-bels provided on a periodic basis. The WSDA-OR Err codemadness.org 70 i 5390 model enforces ordinal relationships among the intensity levels as-signed to Err codemadness.org 70 i 5391 the target sequences, and associates multiple relevant frames to sequence-level Err codemadness.org 70 i 5392 labels (instead of a single frame). In particular, it learns discriminant and Err codemadness.org 70 i 5393 domain-invariant feature representations by integrating multiple in-stance Err codemadness.org 70 i 5394 learning with deep adversarial DA, where soft Gaussian labels are used to Err codemadness.org 70 i 5395 efficiently represent the weak ordinal sequence-level labels from the target Err codemadness.org 70 i 5396 domain. The proposed approach was validated on the RECOLA video dataset as Err codemadness.org 70 i 5397 fully-labeled source domain, and UNBC-McMaster video data as weakly-labeled Err codemadness.org 70 i 5398 target domain. We have also validated WSDA-OR on BIOVID and Fatigue (private) Err codemadness.org 70 i 5399 datasets for sequence level estimation. Experimental results indicate that our Err codemadness.org 70 i 5400 approach can provide a significant improvement over the state-of-the-art Err codemadness.org 70 i 5401 models, allowing to achieve a greater localization accuracy. Err codemadness.org 70 i 5402

Err codemadness.org 70 i 5403

Optimization Fabrics for Behavioral Design. (arXiv:2010.15676v1 [cs.RO])

Second-order differential equations define smooth system behavior. In Err codemadness.org 70 i 5410 general, there is no guarantee that a system will behave well when forced by a Err codemadness.org 70 i 5411 potential function, but in some cases they do and may exhibit smooth Err codemadness.org 70 i 5412 optimization properties such as convergence to a local minimum of the Err codemadness.org 70 i 5413 potential. Such a property is desirable in system design since it is inherently Err codemadness.org 70 i 5414 linked to asymptotic stability. This paper presents a comprehensive theory of Err codemadness.org 70 i 5415 optimization fabrics which are second-order differential equations that encode Err codemadness.org 70 i 5416 nominal behaviors on a space and are guaranteed to optimize when forced away Err codemadness.org 70 i 5417 from those nominal trajectories by a potential function. Optimization fabrics, Err codemadness.org 70 i 5418 or fabrics for short, can encode commonalities among optimization problems that Err codemadness.org 70 i 5419 reflect the structure of the space itself, enabling smooth optimization Err codemadness.org 70 i 5420 processes to intelligently navigate each problem even when the potential Err codemadness.org 70 i 5421 function is simple and relatively naive. Importantly, optimization over a Err codemadness.org 70 i 5422 fabric is asymptotically stable, so optimization fabrics constitute a building Err codemadness.org 70 i 5423 block for provably stable system design. Err codemadness.org 70 i 5424

Err codemadness.org 70 i 5425

On the Failure of the Smart Approach of the GPT Cryptosystem. (arXiv:2010.15678v1 [cs.CR])

This paper describes a new algorithm for breaking the smart approach of the Err codemadness.org 70 i 5432 GPT cryptosystem. We show that by puncturing the public code several times on Err codemadness.org 70 i 5433 specific positions, we get a public code on which applying the Frobenius Err codemadness.org 70 i 5434 operator appropriately allows to build an alternative secret key. Err codemadness.org 70 i 5435

Err codemadness.org 70 i 5436

Lie-Trotter Splitting for the Nonlinear Stochastic Manakov System. (arXiv:2010.15679v1 [math.AP])

This article analyses the convergence of the Lie-Trotter splitting scheme for Err codemadness.org 70 i 5443 the stochastic Manakov equation, a system arising in the study of pulse Err codemadness.org 70 i 5444 propagation in randomly birefringent optical fibers. First, we prove that the Err codemadness.org 70 i 5445 strong order of the numerical approximation is 1/2 if the nonlinear term in the Err codemadness.org 70 i 5446 system is globally Lipschitz. Then, we show that the splitting scheme has Err codemadness.org 70 i 5447 convergence order 1/2 in probability and almost sure order 1/2- in the case of Err codemadness.org 70 i 5448 a cubic nonlinearity. We provide several numerical experiments illustrating the Err codemadness.org 70 i 5449 aforementioned results and the efficiency of the Lie-Trotter splitting scheme. Err codemadness.org 70 i 5450 Finally, we numerically investigate the possible blowup of solutions for some Err codemadness.org 70 i 5451 power-law nonlinearities. Err codemadness.org 70 i 5452

Err codemadness.org 70 i 5453

LSTM for Model-Based Anomaly Detection in Cyber-Physical Systems. (arXiv:2010.15680v1 [cs.LG])

Anomaly detection is the task of detecting data which differs from the normal Err codemadness.org 70 i 5460 behaviour of a system in a given context. In order to approach this problem, Err codemadness.org 70 i 5461 data-driven models can be learned to predict current or future observations. Err codemadness.org 70 i 5462 Oftentimes, anomalous behaviour depends on the internal dynamics of the system Err codemadness.org 70 i 5463 and looks normal in a static context. To address this problem, the model should Err codemadness.org 70 i 5464 also operate depending on state. Long Short-Term Memory (LSTM) neural networks Err codemadness.org 70 i 5465 have been shown to be particularly useful to learn time sequences with varying Err codemadness.org 70 i 5466 length of temporal dependencies and are therefore an interesting general Err codemadness.org 70 i 5467 purpose approach to learn the behaviour of arbitrarily complex Cyber-Physical Err codemadness.org 70 i 5468 Systems. In order to perform anomaly detection, we slightly modify the standard Err codemadness.org 70 i 5469 norm 2 error to incorporate an estimate of model uncertainty. We analyse the Err codemadness.org 70 i 5470 approach on artificial and real data. Err codemadness.org 70 i 5471

Err codemadness.org 70 i 5472

Maximum a posteriori signal recovery for optical coherence tomography angiography image generation and denoising. (arXiv:2010.15682v1 [eess.IV])

Optical coherence tomography angiography (OCTA) is a novel and clinically Err codemadness.org 70 i 5479 promising imaging modality to image retinal and sub-retinal vasculature. Based Err codemadness.org 70 i 5480 on repeated optical coherence tomography (OCT) scans, intensity changes are Err codemadness.org 70 i 5481 observed over time and used to compute OCTA image data. OCTA data are prone to Err codemadness.org 70 i 5482 noise and artifacts caused by variations in flow speed and patient movement. We Err codemadness.org 70 i 5483 propose a novel iterative maximum a posteriori signal recovery algorithm in Err codemadness.org 70 i 5484 order to generate OCTA volumes with reduced noise and increased image quality. Err codemadness.org 70 i 5485 This algorithm is based on previous work on probabilistic OCTA signal models Err codemadness.org 70 i 5486 and maximum likelihood estimates. Reconstruction results using total variation Err codemadness.org 70 i 5487 minimization and wavelet shrinkage for regularization were compared against an Err codemadness.org 70 i 5488 OCTA ground truth volume, merged from six co-registered single OCTA volumes. Err codemadness.org 70 i 5489 The results show a significant improvement in peak signal-to-noise ratio and Err codemadness.org 70 i 5490 structural similarity. The presented algorithm brings together OCTA image Err codemadness.org 70 i 5491 generation and Bayesian statistics and can be developed into new OCTA image Err codemadness.org 70 i 5492 generation and denoising algorithms. Err codemadness.org 70 i 5493

Err codemadness.org 70 i 5494

Resilient Energy Efficient Healthcare Monitoring Infrastructure with Server and Network Protection. (arXiv:2010.15683v1 [eess.SY])

In this paper, a 1+1 server protection scheme is considered where two Err codemadness.org 70 i 5501 servers, a primary and a secondary processing server are used to serve ECG Err codemadness.org 70 i 5502 monitoring applications concurrently. The infrastructure is designed to be Err codemadness.org 70 i 5503 resilient against server failure under two scenarios related to the geographic Err codemadness.org 70 i 5504 location of primary and secondary servers and resilient against both server and Err codemadness.org 70 i 5505 network failures. A Mixed Integer Linear Programming (MILP) model is used to Err codemadness.org 70 i 5506 optimise the number and locations of both primary and secondary processing Err codemadness.org 70 i 5507 servers so that the energy consumption of the networking equipment and Err codemadness.org 70 i 5508 processing are minimised. The results show that considering a scenario for Err codemadness.org 70 i 5509 server protection without geographical constraints compared to the Err codemadness.org 70 i 5510 non-resilient scenario has resulted in both network and processing energy Err codemadness.org 70 i 5511 penalty as the traffic is doubled. The results also reveal that increasing the Err codemadness.org 70 i 5512 level of resilience to consider geographical constraints compared to case Err codemadness.org 70 i 5513 without geographical constraints resulted in higher network energy penalty when Err codemadness.org 70 i 5514 the demand is low as more nodes are utilised to place the processing servers Err codemadness.org 70 i 5515 under the geographic constraints. Also, increasing the level of resilience to Err codemadness.org 70 i 5516 consider network protection with link and node disjoint selection has resulted Err codemadness.org 70 i 5517 in a low network energy penalty at high demands due to the activation of a Err codemadness.org 70 i 5518 large part of the network in any case due to the demands. However, the results Err codemadness.org 70 i 5519 show that the network energy penalty is reduced with the increasing number of Err codemadness.org 70 i 5520 processing servers at each candidate node. Meanwhile, the same energy for Err codemadness.org 70 i 5521 processing is consumed regardless of the increasing level of resilience as the Err codemadness.org 70 i 5522 same number of processing servers are utilised. A heuristic is developed for Err codemadness.org 70 i 5523 each resilience scenario for real-time implementation where the results show Err codemadness.org 70 i 5524 that the performance of the heuristic is approaching the results of the MILP Err codemadness.org 70 i 5525 model. Err codemadness.org 70 i 5526

Err codemadness.org 70 i 5527

Governance & Autonomy: Towards a Governance-based Analysis of Autonomy in Cyber-Physical Systems-of-Systems. (arXiv:2010.15684v1 [cs.SE])

One of the main challenges in integrating Cyber-Physical System-of-Systems Err codemadness.org 70 i 5534 (CPSoS) to function as a single unified system is the autonomy of its Err codemadness.org 70 i 5535 Cyber-Physical Systems (CPSs), which may lead to a lack of coordination among Err codemadness.org 70 i 5536 CPSs and results in various kinds of conflicts. We advocate that to efficiently Err codemadness.org 70 i 5537 integrate CPSs within the CPSoS, we may need to adjust the autonomy of some Err codemadness.org 70 i 5538 CPSs in a way that allows them to coordinate their activities to avoid any Err codemadness.org 70 i 5539 potential conflict among one another. To achieve that, we need to incorporate Err codemadness.org 70 i 5540 the notion of governance within the design of CPSoS, which defines rules that Err codemadness.org 70 i 5541 can be used for clearly specifying who and how can adjust the autonomy of a Err codemadness.org 70 i 5542 CPS. In this paper, we try to tackle this problem by proposing a new conceptual Err codemadness.org 70 i 5543 model that can be used for performing a governance-based analysis of autonomy Err codemadness.org 70 i 5544 for CPSs within CPSoS. We illustrate the utility of the model with an example Err codemadness.org 70 i 5545 from the automotive domain. Err codemadness.org 70 i 5546

Err codemadness.org 70 i 5547

Deep Autofocus for Synthetic Aperture Sonar. (arXiv:2010.15687v1 [eess.IV])

Synthetic aperture sonar (SAS) requires precise positional and environmental Err codemadness.org 70 i 5554 information to produce well-focused output during the image reconstruction Err codemadness.org 70 i 5555 step. However, errors in these measurements are commonly present resulting in Err codemadness.org 70 i 5556 defocused imagery. To overcome these issues, an \emph{autofocus} algorithm is Err codemadness.org 70 i 5557 employed as a post-processing step after image reconstruction for the purpose Err codemadness.org 70 i 5558 of improving image quality using the image content itself. These algorithms are Err codemadness.org 70 i 5559 usually iterative and metric-based in that they seek to optimize an image Err codemadness.org 70 i 5560 sharpness metric. In this letter, we demonstrate the potential of machine Err codemadness.org 70 i 5561 learning, specifically deep learning, to address the autofocus problem. We Err codemadness.org 70 i 5562 formulate the problem as a self-supervised, phase error estimation task using a Err codemadness.org 70 i 5563 deep network we call Deep Autofocus. Our formulation has the advantages of Err codemadness.org 70 i 5564 being non-iterative (and thus fast) and not requiring ground truth Err codemadness.org 70 i 5565 focused-defocused images pairs as often required by other deblurring deep Err codemadness.org 70 i 5566 learning methods. We compare our technique against a set of common sharpness Err codemadness.org 70 i 5567 metrics optimized using gradient descent over a real-world dataset. Our results Err codemadness.org 70 i 5568 demonstrate Deep Autofocus can produce imagery that is perceptually as good as Err codemadness.org 70 i 5569 benchmark iterative techniques but at a substantially lower computational cost. Err codemadness.org 70 i 5570 We conclude that our proposed Deep Autofocus can provide a more favorable Err codemadness.org 70 i 5571 cost-quality trade-off than state-of-the-art alternatives with significant Err codemadness.org 70 i 5572 potential of future research. Err codemadness.org 70 i 5573

Err codemadness.org 70 i 5574

Learning Deep Interleaved Networks with Asymmetric Co-Attention for Image Restoration. (arXiv:2010.15689v1 [cs.CV])

Recently, convolutional neural network (CNN) has demonstrated significant Err codemadness.org 70 i 5581 success for image restoration (IR) tasks (e.g., image super-resolution, image Err codemadness.org 70 i 5582 deblurring, rain streak removal, and dehazing). However, existing CNN based Err codemadness.org 70 i 5583 models are commonly implemented as a single-path stream to enrich feature Err codemadness.org 70 i 5584 representations from low-quality (LQ) input space for final predictions, which Err codemadness.org 70 i 5585 fail to fully incorporate preceding low-level contexts into later high-level Err codemadness.org 70 i 5586 features within networks, thereby producing inferior results. In this paper, we Err codemadness.org 70 i 5587 present a deep interleaved network (DIN) that learns how information at Err codemadness.org 70 i 5588 different states should be combined for high-quality (HQ) images Err codemadness.org 70 i 5589 reconstruction. The proposed DIN follows a multi-path and multi-branch pattern Err codemadness.org 70 i 5590 allowing multiple interconnected branches to interleave and fuse at different Err codemadness.org 70 i 5591 states. In this way, the shallow information can guide deep representative Err codemadness.org 70 i 5592 features prediction to enhance the feature expression ability. Furthermore, we Err codemadness.org 70 i 5593 propose asymmetric co-attention (AsyCA) which is attached at each interleaved Err codemadness.org 70 i 5594 node to model the feature dependencies. Such AsyCA can not only adaptively Err codemadness.org 70 i 5595 emphasize the informative features from different states, but also improves the Err codemadness.org 70 i 5596 discriminative ability of networks. Our presented DIN can be trained end-to-end Err codemadness.org 70 i 5597 and applied to various IR tasks. Comprehensive evaluations on public benchmarks Err codemadness.org 70 i 5598 and real-world datasets demonstrate that the proposed DIN perform favorably Err codemadness.org 70 i 5599 against the state-of-the-art methods quantitatively and qualitatively. Err codemadness.org 70 i 5600

Err codemadness.org 70 i 5601

Analyzing the tree-layer structure of Deep Forests. (arXiv:2010.15690v1 [cs.LG])

Random forests on the one hand, and neural networks on the other hand, have Err codemadness.org 70 i 5608 met great success in the machine learning community for their predictive Err codemadness.org 70 i 5609 performance. Combinations of both have been proposed in the literature, notably Err codemadness.org 70 i 5610 leading to the so-called deep forests (DF) [25]. In this paper, we investigate Err codemadness.org 70 i 5611 the mechanisms at work in DF and outline that DF architecture can generally be Err codemadness.org 70 i 5612 simplified into more simple and computationally efficient shallow forests Err codemadness.org 70 i 5613 networks. Despite some instability, the latter may outperform standard Err codemadness.org 70 i 5614 predictive tree-based methods. In order to precisely quantify the improvement Err codemadness.org 70 i 5615 achieved by these light network configurations over standard tree learners, we Err codemadness.org 70 i 5616 theoretically study the performance of a shallow tree network made of two Err codemadness.org 70 i 5617 layers, each one composed of a single centered tree. We provide tight Err codemadness.org 70 i 5618 theoretical lower and upper bounds on its excess risk. These theoretical Err codemadness.org 70 i 5619 results show the interest of tree-network architectures for well-structured Err codemadness.org 70 i 5620 data provided that the first layer, acting as a data encoder, is rich enough. Err codemadness.org 70 i 5621

Err codemadness.org 70 i 5622

Unveiling process insights from refactoring practices. (arXiv:2010.15692v1 [cs.SE])

Context : Software comprehension and maintenance activities, such as Err codemadness.org 70 i 5629 refactoring, are said to be negatively impacted by software complexity. The Err codemadness.org 70 i 5630 methods used to measure software product and processes complexity have been Err codemadness.org 70 i 5631 thoroughly debated in the literature. However, the discernment about the Err codemadness.org 70 i 5632 possible links between these two dimensions, particularly on the benefits of Err codemadness.org 70 i 5633 using the process perspective, has a long journey ahead. Objective: To improve Err codemadness.org 70 i 5634 the understanding of the liaison of developers' activities and software Err codemadness.org 70 i 5635 complexity within a refactoring task, namely by evaluating if process metrics Err codemadness.org 70 i 5636 gathered from the IDE, using process mining methods and tools, are suitable to Err codemadness.org 70 i 5637 accurately classify different refactoring practices and the resulting software Err codemadness.org 70 i 5638 complexity. Method: We mined source code metrics from a software product after Err codemadness.org 70 i 5639 a quality improvement task was given in parallel to (117) software developers, Err codemadness.org 70 i 5640 organized in (71) teams. Simultaneously, we collected events from their IDE Err codemadness.org 70 i 5641 work sessions (320) and used process mining to model their processes and Err codemadness.org 70 i 5642 extract the correspondent metrics. Results: Most teams using a plugin for Err codemadness.org 70 i 5643 refactoring (JDeodorant) reduced software complexity more effectively and with Err codemadness.org 70 i 5644 simpler processes than the ones that performed refactoring using only Eclipse Err codemadness.org 70 i 5645 native features. We were able to find moderate correlations (43%) between Err codemadness.org 70 i 5646 software cyclomatic complexity and process cyclomatic complexity. The best Err codemadness.org 70 i 5647 models found for the refactoring method and cyclomatic complexity level Err codemadness.org 70 i 5648 predictions, had an accuracy of 92.95% and 94.36%, respectively. Conclusions: Err codemadness.org 70 i 5649 Our approach agnostic to programming languages, geographic location, or Err codemadness.org 70 i 5650 development practices. Initial findings are encouraging, and lead us to suggest Err codemadness.org 70 i 5651 practitioners may use our method in other development tasks, such as, defect Err codemadness.org 70 i 5652 analysis and unit or integration tests. Err codemadness.org 70 i 5653

Err codemadness.org 70 i 5654

Learning interaction kernels in mean-field equations of 1st-order systems of interacting particles. (arXiv:2010.15694v1 [stat.ML])

We introduce a nonparametric algorithm to learn interaction kernels of Err codemadness.org 70 i 5661 mean-field equations for 1st-order systems of interacting particles. The data Err codemadness.org 70 i 5662 consist of discrete space-time observations of the solution. By least squares Err codemadness.org 70 i 5663 with regularization, the algorithm learns the kernel on data-adaptive Err codemadness.org 70 i 5664 hypothesis spaces efficiently. A key ingredient is a probabilistic error Err codemadness.org 70 i 5665 functional derived from the likelihood of the mean-field equation's diffusion Err codemadness.org 70 i 5666 process. The estimator converges, in a reproducing kernel Hilbert space and an Err codemadness.org 70 i 5667 L2 space under an identifiability condition, at a rate optimal in the sense Err codemadness.org 70 i 5668 that it equals the numerical integrator's order. We demonstrate our algorithm Err codemadness.org 70 i 5669 on three typical examples: the opinion dynamics with a piecewise linear kernel, Err codemadness.org 70 i 5670 the granular media model with a quadratic kernel, and the aggregation-diffusion Err codemadness.org 70 i 5671 with a repulsive-attractive kernel. Err codemadness.org 70 i 5672

Err codemadness.org 70 i 5673

Generalized Insider Attack Detection Implementation using NetFlow Data. (arXiv:2010.15697v1 [cs.CR])

Insider Attack Detection in commercial networks is a critical problem that Err codemadness.org 70 i 5680 does not have any good solutions at this current time. The problem is Err codemadness.org 70 i 5681 challenging due to the lack of visibility into live networks and a lack of a Err codemadness.org 70 i 5682 standard feature set to distinguish between different attacks. In this paper, Err codemadness.org 70 i 5683 we study an approach centered on using network data to identify attacks. Our Err codemadness.org 70 i 5684 work builds on unsupervised machine learning techniques such as One-Class SVM Err codemadness.org 70 i 5685 and bi-clustering as weak indicators of insider network attacks. We combine Err codemadness.org 70 i 5686 these techniques to limit the number of false positives to an acceptable level Err codemadness.org 70 i 5687 required for real-world deployments by using One-Class SVM to check for Err codemadness.org 70 i 5688 anomalies detected by the proposed Bi-clustering algorithm. We present a Err codemadness.org 70 i 5689 prototype implementation in Python and associated results for two different Err codemadness.org 70 i 5690 real-world representative data sets. We show that our approach is a promising Err codemadness.org 70 i 5691 tool for insider attack detection in realistic settings. Err codemadness.org 70 i 5692

Err codemadness.org 70 i 5693

Constrained Online Learning to Mitigate Distortion Effects in Pulse-Agile Cognitive Radar. (arXiv:2010.15698v1 [cs.IT])

Pulse-agile radar systems have demonstrated favorable performance in dynamic Err codemadness.org 70 i 5700 electromagnetic scenarios. However, the use of non-identical waveforms within a Err codemadness.org 70 i 5701 radar's coherent processing interval may lead to harmful distortion effects Err codemadness.org 70 i 5702 when pulse-Doppler processing is used. This paper presents an online learning Err codemadness.org 70 i 5703 framework to optimize detection performance while mitigating harmful sidelobe Err codemadness.org 70 i 5704 levels. The radar waveform selection process is formulated as a linear Err codemadness.org 70 i 5705 contextual bandit problem, within which waveform adaptations which exceed a Err codemadness.org 70 i 5706 tolerable level of expected distortion are eliminated. The constrained online Err codemadness.org 70 i 5707 learning approach is effective and computationally feasible, evidenced by Err codemadness.org 70 i 5708 simulations in a radar-communication coexistence scenario and in the presence Err codemadness.org 70 i 5709 of intentional adaptive jamming. This approach is applied to both stochastic Err codemadness.org 70 i 5710 and adversarial contextual bandit learning models and the detection performance Err codemadness.org 70 i 5711 in dynamic scenarios is evaluated. Err codemadness.org 70 i 5712

Err codemadness.org 70 i 5713

Permute, Quantize, and Fine-tune: Efficient Compression of Neural Networks. (arXiv:2010.15703v1 [cs.CV])

Compressing large neural networks is an important step for their deployment Err codemadness.org 70 i 5720 in resource-constrained computational platforms. In this context, vector Err codemadness.org 70 i 5721 quantization is an appealing framework that expresses multiple parameters using Err codemadness.org 70 i 5722 a single code, and has recently achieved state-of-the-art network compression Err codemadness.org 70 i 5723 on a range of core vision and natural language processing tasks. Key to the Err codemadness.org 70 i 5724 success of vector quantization is deciding which parameter groups should be Err codemadness.org 70 i 5725 compressed together. Previous work has relied on heuristics that group the Err codemadness.org 70 i 5726 spatial dimension of individual convolutional filters, but a general solution Err codemadness.org 70 i 5727 remains unaddressed. This is desirable for pointwise convolutions (which Err codemadness.org 70 i 5728 dominate modern architectures), linear layers (which have no notion of spatial Err codemadness.org 70 i 5729 dimension), and convolutions (when more than one filter is compressed to the Err codemadness.org 70 i 5730 same codeword). In this paper we make the observation that the weights of two Err codemadness.org 70 i 5731 adjacent layers can be permuted while expressing the same function. We then Err codemadness.org 70 i 5732 establish a connection to rate-distortion theory and search for permutations Err codemadness.org 70 i 5733 that result in networks that are easier to compress. Finally, we rely on an Err codemadness.org 70 i 5734 annealed quantization algorithm to better compress the network and achieve Err codemadness.org 70 i 5735 higher final accuracy. We show results on image classification, object Err codemadness.org 70 i 5736 detection, and segmentation, reducing the gap with the uncompressed model by 40 Err codemadness.org 70 i 5737 to 70% with respect to the current state of the art. Err codemadness.org 70 i 5738

Err codemadness.org 70 i 5739

5W1H-based Expression for the Effective Sharing of Information in Digital Forensic Investigations. (arXiv:2010.15711v1 [cs.CR])

Digital forensic investigation is used in various areas related to digital Err codemadness.org 70 i 5746 devices including the cyber crime. This is an investigative process using many Err codemadness.org 70 i 5747 techniques, which have implemented as tools. The types of files covered by the Err codemadness.org 70 i 5748 digital forensic investigation are wide and varied, however, there is no way to Err codemadness.org 70 i 5749 express the results into a standardized format. The standardization are Err codemadness.org 70 i 5750 different by types of device, file system, or application. Different outputs Err codemadness.org 70 i 5751 make it time-consuming and difficult to share information and to implement Err codemadness.org 70 i 5752 integration. In addition, it could weaken cyber security. Thus, it is important Err codemadness.org 70 i 5753 to define normalization and to present data in the same format. In this paper, Err codemadness.org 70 i 5754 a 5W1H-based expression for information sharing for effective digital forensic Err codemadness.org 70 i 5755 investigation is proposed to analyze digital forensic information using six Err codemadness.org 70 i 5756 questions--what, who, where, when, why and how. Based on the 5W1H-based Err codemadness.org 70 i 5757 expression, digital information from different types of files is converted and Err codemadness.org 70 i 5758 represented in the same format of outputs. As the 5W1H is the basic writing Err codemadness.org 70 i 5759 principle, application of the 5W1H-based expression on the case studies shows Err codemadness.org 70 i 5760 that this expression enhances clarity and correctness for information sharing. Err codemadness.org 70 i 5761 Furthermore, in the case of security incidents, this expression has an Err codemadness.org 70 i 5762 advantage in being compatible with STIX. Err codemadness.org 70 i 5763

Err codemadness.org 70 i 5764

Playing a Part: Speaker Verification at the Movies. (arXiv:2010.15716v1 [cs.SD])

The goal of this work is to investigate the performance of popular speaker Err codemadness.org 70 i 5771 recognition models on speech segments from movies, where often actors Err codemadness.org 70 i 5772 intentionally disguise their voice to play a character. We make the following Err codemadness.org 70 i 5773 three contributions: (i) We collect a novel, challenging speaker recognition Err codemadness.org 70 i 5774 dataset called VoxMovies, with speech for 856 identities from almost 4000 movie Err codemadness.org 70 i 5775 clips. VoxMovies contains utterances with varying emotion, accents and Err codemadness.org 70 i 5776 background noise, and therefore comprises an entirely different domain to the Err codemadness.org 70 i 5777 interview-style, emotionally calm utterances in current speaker recognition Err codemadness.org 70 i 5778 datasets such as VoxCeleb; (ii) We provide a number of domain adaptation Err codemadness.org 70 i 5779 evaluation sets, and benchmark the performance of state-of-the-art speaker Err codemadness.org 70 i 5780 recognition models on these evaluation pairs. We demonstrate that both speaker Err codemadness.org 70 i 5781 verification and identification performance drops steeply on this new data, Err codemadness.org 70 i 5782 showing the challenge in transferring models across domains; and finally (iii) Err codemadness.org 70 i 5783 We show that simple domain adaptation paradigms improve performance, but there Err codemadness.org 70 i 5784 is still large room for improvement. Err codemadness.org 70 i 5785

Err codemadness.org 70 i 5786

What can we learn from gradients?. (arXiv:2010.15718v1 [cs.CR])

Recent work (\cite{zhu2019deep}) has shown that it is possible to reconstruct Err codemadness.org 70 i 5793 the input (image) from the gradient of a neural network. In this paper, our aim Err codemadness.org 70 i 5794 is to better understand the limits to reconstruction and to speed up image Err codemadness.org 70 i 5795 reconstruction by imposing prior image information and improved initialization. Err codemadness.org 70 i 5796 Firstly, we show that for the \textbf{non-linear} neural network, Err codemadness.org 70 i 5797 gradient-based reconstruction approximates to solving a high-dimension Err codemadness.org 70 i 5798 \textbf{linear} equations for both fully-connected neural network and Err codemadness.org 70 i 5799 convolutional neural network. Exploring the theoretical limits of input Err codemadness.org 70 i 5800 reconstruction, we show that a fully-connected neural network with a Err codemadness.org 70 i 5801 \textbf{one} hidden node is enough to reconstruct a \textbf{single} input Err codemadness.org 70 i 5802 image, regardless of the number of nodes in the output layer. Then we Err codemadness.org 70 i 5803 generalize this result to a gradient averaged over mini-batches of size B. In Err codemadness.org 70 i 5804 this case, the full mini-batch can be reconstructed in a fully-connected Err codemadness.org 70 i 5805 network if the number of hidden units exceeds B. For a convolutional neural Err codemadness.org 70 i 5806 network, the required number of filters in the first convolutional layer again Err codemadness.org 70 i 5807 is decided by the batch size B, however, in this case, input width d and the Err codemadness.org 70 i 5808 width after filter $d^{'}$ also play the role $h=(\frac{d}{d^{'}})^2BC$, where Err codemadness.org 70 i 5809 C is channel number of input. Finally, we validate and underpin our theoretical Err codemadness.org 70 i 5810 analysis on bio-medical data (fMRI, ECG signals, and cell images) and on Err codemadness.org 70 i 5811 benchmark data (MNIST, CIFAR100, and face images). Err codemadness.org 70 i 5812

Err codemadness.org 70 i 5813

Attentive Clustering Processes. (arXiv:2010.15727v1 [stat.ML])

Amortized approaches to clustering have recently received renewed attention Err codemadness.org 70 i 5820 thanks to novel objective functions that exploit the expressiveness of deep Err codemadness.org 70 i 5821 learning models. In this work we revisit a recent proposal for fast amortized Err codemadness.org 70 i 5822 probabilistic clustering, the Clusterwise Clustering Process (CCP), which Err codemadness.org 70 i 5823 yields samples from the posterior distribution of cluster labels for sets of Err codemadness.org 70 i 5824 arbitrary size using only O(K) forward network evaluations, where K is an Err codemadness.org 70 i 5825 arbitrary number of clusters. While adequate in simple datasets, we show that Err codemadness.org 70 i 5826 the model can severely underfit complex datasets, and hypothesize that this Err codemadness.org 70 i 5827 limitation can be traced back to the implicit assumption that the probability Err codemadness.org 70 i 5828 of a point joining a cluster is equally sensitive to all the points available Err codemadness.org 70 i 5829 to join the same cluster. We propose an improved model, the Attentive Err codemadness.org 70 i 5830 Clustering Process (ACP), that selectively pays more attention to relevant Err codemadness.org 70 i 5831 points while preserving the invariance properties of the generative model. We Err codemadness.org 70 i 5832 illustrate the advantages of the new model in applications to spike-sorting in Err codemadness.org 70 i 5833 multi-electrode arrays and community discovery in networks. The latter case Err codemadness.org 70 i 5834 combines the ACP model with graph convolutional networks, and to our knowledge Err codemadness.org 70 i 5835 is the first deep learning model that handles an arbitrary number of Err codemadness.org 70 i 5836 communities. Err codemadness.org 70 i 5837

Err codemadness.org 70 i 5838

Explainable Automated Coding of Clinical Notes using Hierarchical Label-wise Attention Networks and Label Embedding Initialisation. (arXiv:2010.15728v1 [cs.CL])

Diagnostic or procedural coding of clinical notes aims to derive a coded Err codemadness.org 70 i 5845 summary of disease-related information about patients. Such coding is usually Err codemadness.org 70 i 5846 done manually in hospitals but could potentially be automated to improve the Err codemadness.org 70 i 5847 efficiency and accuracy of medical coding. Recent studies on deep learning for Err codemadness.org 70 i 5848 automated medical coding achieved promising performances. However, the Err codemadness.org 70 i 5849 explainability of these models is usually poor, preventing them to be used Err codemadness.org 70 i 5850 confidently in supporting clinical practice. Another limitation is that these Err codemadness.org 70 i 5851 models mostly assume independence among labels, ignoring the complex Err codemadness.org 70 i 5852 correlation among medical codes which can potentially be exploited to improve Err codemadness.org 70 i 5853 the performance. We propose a Hierarchical Label-wise Attention Network (HLAN), Err codemadness.org 70 i 5854 which aimed to interpret the model by quantifying importance (as attention Err codemadness.org 70 i 5855 weights) of words and sentences related to each of the labels. Secondly, we Err codemadness.org 70 i 5856 propose to enhance the major deep learning models with a label embedding (LE) Err codemadness.org 70 i 5857 initialisation approach, which learns a dense, continuous vector representation Err codemadness.org 70 i 5858 and then injects the representation into the final layers and the label-wise Err codemadness.org 70 i 5859 attention layers in the models. We evaluated the methods using three settings Err codemadness.org 70 i 5860 on the MIMIC-III discharge summaries: full codes, top-50 codes, and the UK NHS Err codemadness.org 70 i 5861 COVID-19 shielding codes. Experiments were conducted to compare HLAN and LE Err codemadness.org 70 i 5862 initialisation to the state-of-the-art neural network based methods. HLAN Err codemadness.org 70 i 5863 achieved the best Micro-level AUC and $F_1$ on the top-50 code prediction and Err codemadness.org 70 i 5864 comparable results on the NHS COVID-19 shielding code prediction to other Err codemadness.org 70 i 5865 models. By highlighting the most salient words and sentences for each label, Err codemadness.org 70 i 5866 HLAN showed more meaningful and comprehensive model interpretation compared to Err codemadness.org 70 i 5867 its downgraded baselines and the CNN-based models. LE initialisation Err codemadness.org 70 i 5868 consistently boosted most deep learning models for automated medical coding. Err codemadness.org 70 i 5869

Err codemadness.org 70 i 5870

Fundamental limitations to key distillation from Gaussian states with Gaussian operations. (arXiv:2010.15729v1 [quant-ph])

We establish fundamental upper bounds on the amount of secret key that can be Err codemadness.org 70 i 5877 extracted from continuous variable quantum Gaussian states by using only local Err codemadness.org 70 i 5878 Gaussian operations, local classical processing, and public communication. For Err codemadness.org 70 i 5879 one-way communication, we prove that the key is bounded by the R\'enyi-$2$ Err codemadness.org 70 i 5880 Gaussian entanglement of formation $E_{F,2}^{\mathrm{\scriptscriptstyle G}}$, Err codemadness.org 70 i 5881 with the inequality being saturated for pure Gaussian states. The same is true Err codemadness.org 70 i 5882 if two-way public communication is allowed but Alice and Bob employ protocols Err codemadness.org 70 i 5883 that start with destructive local Gaussian measurements. In the most general Err codemadness.org 70 i 5884 setting of two-way communication and arbitrary interactive protocols, we argue Err codemadness.org 70 i 5885 that $2 E_{F,2}^{\mathrm{\scriptscriptstyle G}}$ is still a bound on the Err codemadness.org 70 i 5886 extractable key, although we conjecture that the factor of $2$ is superfluous. Err codemadness.org 70 i 5887 Finally, for a wide class of Gaussian states that includes all two-mode states, Err codemadness.org 70 i 5888 we prove a recently proposed conjecture on the equality between Err codemadness.org 70 i 5889 $E_{F,2}^{\mathrm{\scriptscriptstyle G}}$ and the Gaussian intrinsic Err codemadness.org 70 i 5890 entanglement, thus endowing both measures with a more solid operational Err codemadness.org 70 i 5891 meaning. Err codemadness.org 70 i 5892

Err codemadness.org 70 i 5893

The Agile Coach Role: Coaching for Agile Performance Impact. (arXiv:2010.15738v1 [cs.SE])

It is increasingly common to introduce agile coaches to help gain speed and Err codemadness.org 70 i 5900 advantage in agile companies. Following the success of Spotify, the role of the Err codemadness.org 70 i 5901 agile coach has branched out in terms of tasks and responsibilities, but little Err codemadness.org 70 i 5902 research has been conducted to examine how this role is practiced. This paper Err codemadness.org 70 i 5903 examines the role of the agile coach through 19 semistructured interviews with Err codemadness.org 70 i 5904 agile coaches from ten different companies. We describe the role in terms of Err codemadness.org 70 i 5905 the tasks the coach has in agile projects, valuable traits, skills, tools, and Err codemadness.org 70 i 5906 the enablers of agile coaching. Our findings indicate that agile coaches Err codemadness.org 70 i 5907 perform at the team and organizational levels. They affect effort, strategies, Err codemadness.org 70 i 5908 knowledge, and skills of the agile teams. The most essential traits of an agile Err codemadness.org 70 i 5909 coach are being emphatic, people-oriented, able to listen, diplomatic, and Err codemadness.org 70 i 5910 persistent. We suggest empirically based advice for agile coaching, for example Err codemadness.org 70 i 5911 companies giving their agile coaches the authority to implement the required Err codemadness.org 70 i 5912 organizational changes within and outside the teams. Err codemadness.org 70 i 5913

Err codemadness.org 70 i 5914

Recurrent Neural Networks for video object detection. (arXiv:2010.15740v1 [cs.CV])

There is lots of scientific work about object detection in images. For many Err codemadness.org 70 i 5921 applications like for example autonomous driving the actual data on which Err codemadness.org 70 i 5922 classification has to be done are videos. This work compares different methods, Err codemadness.org 70 i 5923 especially those which use Recurrent Neural Networks to detect objects in Err codemadness.org 70 i 5924 videos. We differ between feature-based methods, which feed feature maps of Err codemadness.org 70 i 5925 different frames into the recurrent units, box-level methods, which feed Err codemadness.org 70 i 5926 bounding boxes with class probabilities into the recurrent units and methods Err codemadness.org 70 i 5927 which use flow networks. This study indicates common outcomes of the compared Err codemadness.org 70 i 5928 methods like the benefit of including the temporal context into object Err codemadness.org 70 i 5929 detection and states conclusions and guidelines for video object detection Err codemadness.org 70 i 5930 networks. Err codemadness.org 70 i 5931

Err codemadness.org 70 i 5932

Causal variables from reinforcement learning using generalized Bellman equations. (arXiv:2010.15745v1 [cs.LG])

Many open problems in machine learning are intrinsically related to Err codemadness.org 70 i 5939 causality, however, the use of causal analysis in machine learning is still in Err codemadness.org 70 i 5940 its early stage. Within a general reinforcement learning setting, we consider Err codemadness.org 70 i 5941 the problem of building a general reinforcement learning agent which uses Err codemadness.org 70 i 5942 experience to construct a causal graph of the environment, and use this graph Err codemadness.org 70 i 5943 to inform its policy. Our approach has three characteristics: First, we learn a Err codemadness.org 70 i 5944 simple, coarse-grained causal graph, in which the variables reflect states at Err codemadness.org 70 i 5945 many time instances, and the interventions happen at the level of policies, Err codemadness.org 70 i 5946 rather than individual actions. Secondly, we use mediation analysis to obtain Err codemadness.org 70 i 5947 an optimization target. By minimizing this target, we define the causal Err codemadness.org 70 i 5948 variables. Thirdly, our approach relies on estimating conditional expectations Err codemadness.org 70 i 5949 rather the familiar expected return from reinforcement learning, and we Err codemadness.org 70 i 5950 therefore apply a generalization of Bellman's equations. We show the method can Err codemadness.org 70 i 5951 learn a plausible causal graph in a grid-world environment, and the agent Err codemadness.org 70 i 5952 obtains an improvement in performance when using the causally informed policy. Err codemadness.org 70 i 5953 To our knowledge, this is the first attempt to apply causal analysis in a Err codemadness.org 70 i 5954 reinforcement learning setting without strict restrictions on the number of Err codemadness.org 70 i 5955 states. We have observed that mediation analysis provides a promising avenue Err codemadness.org 70 i 5956 for transforming the problem of causal acquisition into one of cost-function Err codemadness.org 70 i 5957 minimization, but importantly one which involves estimating conditional Err codemadness.org 70 i 5958 expectations. This is a new challenge, and we think that causal reinforcement Err codemadness.org 70 i 5959 learning will involve development methods suited for online estimation of such Err codemadness.org 70 i 5960 conditional expectations. Finally, a benefit of our approach is the use of very Err codemadness.org 70 i 5961 simple causal models, which are arguably a more natural model of human causal Err codemadness.org 70 i 5962 understanding. Err codemadness.org 70 i 5963

Err codemadness.org 70 i 5964

Gaussian Process Bandit Optimization of theThermodynamic Variational Objective. (arXiv:2010.15750v1 [cs.LG])

Achieving the full promise of the Thermodynamic Variational Objective (TVO),a Err codemadness.org 70 i 5971 recently proposed variational lower bound on the log evidence involving a Err codemadness.org 70 i 5972 one-dimensional Riemann integral approximation, requires choosing a "schedule" Err codemadness.org 70 i 5973 ofsorted discretization points. This paper introduces a bespoke Gaussian Err codemadness.org 70 i 5974 processbandit optimization method for automatically choosing these points. Our Err codemadness.org 70 i 5975 approach not only automates their one-time selection, but also dynamically Err codemadness.org 70 i 5976 adaptstheir positions over the course of optimization, leading to improved Err codemadness.org 70 i 5977 model learning and inference. We provide theoretical guarantees that our bandit Err codemadness.org 70 i 5978 optimizationconverges to the regret-minimizing choice of integration points. Err codemadness.org 70 i 5979 Empirical validation of our algorithm is provided in terms of improved learning Err codemadness.org 70 i 5980 and inference inVariational Autoencoders and Sigmoid Belief Networks. Err codemadness.org 70 i 5981

Err codemadness.org 70 i 5982

A more Pragmatic Implementation of the Lock-free, Ordered, Linked List. (arXiv:2010.15755v1 [cs.DS])

The lock-free, ordered, linked list is an important, standard example of a Err codemadness.org 70 i 5989 concurrent data structure. An obvious, practical drawback of textbook Err codemadness.org 70 i 5990 implementations is that failed compare-and-swap (CAS) operations lead to Err codemadness.org 70 i 5991 retraversal of the entire list (retries), which is particularly harmful for Err codemadness.org 70 i 5992 such a linear-time data structure. We alleviate this drawback by first Err codemadness.org 70 i 5993 observing that failed CAS operations under some conditions do not require a Err codemadness.org 70 i 5994 full retry, and second by maintaining approximate backwards pointers that are Err codemadness.org 70 i 5995 used to find a closer starting position in the list for operation retry. Err codemadness.org 70 i 5996 Experiments with both a worst-case deterministic benchmark, and a standard, Err codemadness.org 70 i 5997 randomized, mixed-operation throughput benchmark on three shared-memory systems Err codemadness.org 70 i 5998 (Intel Xeon, AMD EPYC, SPARC-T5) show practical improvements ranging from Err codemadness.org 70 i 5999 significant, to dramatic, several orders of magnitude. Err codemadness.org 70 i 6000

Err codemadness.org 70 i 6001

Identifying Transition States of Chemical Kinetic Systems using Network Embedding Techniques. (arXiv:2010.15760v1 [math.NA])

Using random walk sampling methods for feature learning on networks, we Err codemadness.org 70 i 6008 develop a method for generating low-dimensional node embeddings for directed Err codemadness.org 70 i 6009 graphs and identifying transition states of stochastic chemical reacting Err codemadness.org 70 i 6010 systems. We modified objective functions adopted in existing random walk based Err codemadness.org 70 i 6011 network embedding methods to handle directed graphs and neighbors of different Err codemadness.org 70 i 6012 degrees. Through optimization via gradient ascent, we embed the weighted graph Err codemadness.org 70 i 6013 vertices into a low-dimensional vector space Rd while preserving the Err codemadness.org 70 i 6014 neighborhood of each node. We then demonstrate the effectiveness of the method Err codemadness.org 70 i 6015 on dimension reduction through several examples regarding identification of Err codemadness.org 70 i 6016 transition states of chemical reactions, especially for entropic systems. Err codemadness.org 70 i 6017

Err codemadness.org 70 i 6018

A Helmholtz equation solver using unsupervised learning: Application to transcranial ultrasound. (arXiv:2010.15761v1 [physics.comp-ph])

Transcranial ultrasound therapy is increasingly used for the non-invasive Err codemadness.org 70 i 6025 treatment of brain disorders. However, conventional numerical wave solvers are Err codemadness.org 70 i 6026 currently too computationally expensive to be used online during treatments to Err codemadness.org 70 i 6027 predict the acoustic field passing through the skull (e.g., to account for Err codemadness.org 70 i 6028 subject-specific dose and targeting variations). As a step towards real-time Err codemadness.org 70 i 6029 predictions, in the current work, a fast iterative solver for the heterogeneous Err codemadness.org 70 i 6030 Helmholtz equation in 2D is developed using a fully-learned optimizer. The Err codemadness.org 70 i 6031 lightweight network architecture is based on a modified UNet that includes a Err codemadness.org 70 i 6032 learned hidden state. The network is trained using a physics-based loss Err codemadness.org 70 i 6033 function and a set of idealized sound speed distributions with fully Err codemadness.org 70 i 6034 unsupervised training (no knowledge of the true solution is required). The Err codemadness.org 70 i 6035 learned optimizer shows excellent performance on the test set, and is capable Err codemadness.org 70 i 6036 of generalization well outside the training examples, including to much larger Err codemadness.org 70 i 6037 computational domains, and more complex source and sound speed distributions, Err codemadness.org 70 i 6038 for example, those derived from x-ray computed tomography images of the skull. Err codemadness.org 70 i 6039

Err codemadness.org 70 i 6040

Domain adaptation under structural causal models. (arXiv:2010.15764v1 [stat.ML])

Domain adaptation (DA) arises as an important problem in statistical machine Err codemadness.org 70 i 6047 learning when the source data used to train a model is different from the Err codemadness.org 70 i 6048 target data used to test the model. Recent advances in DA have mainly been Err codemadness.org 70 i 6049 application-driven and have largely relied on the idea of a common subspace for Err codemadness.org 70 i 6050 source and target data. To understand the empirical successes and failures of Err codemadness.org 70 i 6051 DA methods, we propose a theoretical framework via structural causal models Err codemadness.org 70 i 6052 that enables analysis and comparison of the prediction performance of DA Err codemadness.org 70 i 6053 methods. This framework also allows us to itemize the assumptions needed for Err codemadness.org 70 i 6054 the DA methods to have a low target error. Additionally, with insights from our Err codemadness.org 70 i 6055 theory, we propose a new DA method called CIRM that outperforms existing DA Err codemadness.org 70 i 6056 methods when both the covariates and label distributions are perturbed in the Err codemadness.org 70 i 6057 target data. We complement the theoretical analysis with extensive simulations Err codemadness.org 70 i 6058 to show the necessity of the devised assumptions. Reproducible synthetic and Err codemadness.org 70 i 6059 real data experiments are also provided to illustrate the strengths and Err codemadness.org 70 i 6060 weaknesses of DA methods when parts of the assumptions of our theory are Err codemadness.org 70 i 6061 violated. Err codemadness.org 70 i 6062

Err codemadness.org 70 i 6063

A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems. (arXiv:2010.15768v1 [math.OC])

Nonconvex-concave min-max problem arises in many machine learning Err codemadness.org 70 i 6070 applications including minimizing a pointwise maximum of a set of nonconvex Err codemadness.org 70 i 6071 functions and robust adversarial training of neural networks. A popular Err codemadness.org 70 i 6072 approach to solve this problem is the gradient descent-ascent (GDA) algorithm Err codemadness.org 70 i 6073 which unfortunately can exhibit oscillation in case of nonconvexity. In this Err codemadness.org 70 i 6074 paper, we introduce a "smoothing" scheme which can be combined with GDA to Err codemadness.org 70 i 6075 stabilize the oscillation and ensure convergence to a stationary solution. We Err codemadness.org 70 i 6076 prove that the stabilized GDA algorithm can achieve an $O(1/\epsilon^2)$ Err codemadness.org 70 i 6077 iteration complexity for minimizing the pointwise maximum of a finite Err codemadness.org 70 i 6078 collection of nonconvex functions. Moreover, the smoothed GDA algorithm Err codemadness.org 70 i 6079 achieves an $O(1/\epsilon^4)$ iteration complexity for general Err codemadness.org 70 i 6080 nonconvex-concave problems. Extensions of this stabilized GDA algorithm to Err codemadness.org 70 i 6081 multi-block cases are presented. To the best of our knowledge, this is the Err codemadness.org 70 i 6082 first algorithm to achieve $O(1/\epsilon^2)$ for a class of nonconvex-concave Err codemadness.org 70 i 6083 problem. We illustrate the practical efficiency of the stabilized GDA algorithm Err codemadness.org 70 i 6084 on robust training. Err codemadness.org 70 i 6085

Err codemadness.org 70 i 6086

Recursive Random Contraction Revisited. (arXiv:2010.15770v1 [cs.DS])

In this note, we revisit the recursive random contraction algorithm of Karger Err codemadness.org 70 i 6093 and Stein for finding a minimum cut in a graph. Our revisit is occasioned by a Err codemadness.org 70 i 6094 paper of Fox, Panigrahi, and Zhang which gives an extension of the Karger-Stein Err codemadness.org 70 i 6095 algorithm to minimum cuts and minimum $k$-cuts in hypergraphs. When specialized Err codemadness.org 70 i 6096 to the case of graphs, the algorithm is somewhat different than the original Err codemadness.org 70 i 6097 Karger-Stein algorithm. We show that the analysis becomes particularly clean in Err codemadness.org 70 i 6098 this case: we can prove that the probability that a fixed minimum cut in an $n$ Err codemadness.org 70 i 6099 node graph is returned by the algorithm is bounded below by $1/(2H_n-2)$, where Err codemadness.org 70 i 6100 $H_n$ is the $n$th harmonic number. We also consider other similar variants of Err codemadness.org 70 i 6101 the algorithm, and show that no such algorithm can achieve an asymptotically Err codemadness.org 70 i 6102 better probability of finding a fixed minimum cut. Err codemadness.org 70 i 6103

Err codemadness.org 70 i 6104

GANs & Reels: Creating Irish Music using a Generative Adversarial Network. (arXiv:2010.15772v1 [cs.SD])

In this paper we present a method for algorithmic melody generation using a Err codemadness.org 70 i 6111 generative adversarial network without recurrent components. Music generation Err codemadness.org 70 i 6112 has been successfully done using recurrent neural networks, where the model Err codemadness.org 70 i 6113 learns sequence information that can help create authentic sounding melodies. Err codemadness.org 70 i 6114 Here, we use DC-GAN architecture with dilated convolutions and towers to Err codemadness.org 70 i 6115 capture sequential information as spatial image information, and learn Err codemadness.org 70 i 6116 long-range dependencies in fixed-length melody forms such as Irish traditional Err codemadness.org 70 i 6117 reel. Err codemadness.org 70 i 6118

Err codemadness.org 70 i 6119

WaveTransform: Crafting Adversarial Examples via Input Decomposition. (arXiv:2010.15773v1 [cs.CV])

Frequency spectrum has played a significant role in learning unique and Err codemadness.org 70 i 6126 discriminating features for object recognition. Both low and high frequency Err codemadness.org 70 i 6127 information present in images have been extracted and learnt by a host of Err codemadness.org 70 i 6128 representation learning techniques, including deep learning. Inspired by this Err codemadness.org 70 i 6129 observation, we introduce a novel class of adversarial attacks, namely Err codemadness.org 70 i 6130 `WaveTransform', that creates adversarial noise corresponding to low-frequency Err codemadness.org 70 i 6131 and high-frequency subbands, separately (or in combination). The frequency Err codemadness.org 70 i 6132 subbands are analyzed using wavelet decomposition; the subbands are corrupted Err codemadness.org 70 i 6133 and then used to construct an adversarial example. Experiments are performed Err codemadness.org 70 i 6134 using multiple databases and CNN models to establish the effectiveness of the Err codemadness.org 70 i 6135 proposed WaveTransform attack and analyze the importance of a particular Err codemadness.org 70 i 6136 frequency component. The robustness of the proposed attack is also evaluated Err codemadness.org 70 i 6137 through its transferability and resiliency against a recent adversarial defense Err codemadness.org 70 i 6138 algorithm. Experiments show that the proposed attack is effective against the Err codemadness.org 70 i 6139 defense algorithm and is also transferable across CNNs. Err codemadness.org 70 i 6140

Err codemadness.org 70 i 6141

Understanding the Failure Modes of Out-of-Distribution Generalization. (arXiv:2010.15775v1 [cs.LG])

Empirical studies suggest that machine learning models often rely on Err codemadness.org 70 i 6148 features, such as the background, that may be spuriously correlated with the Err codemadness.org 70 i 6149 label only during training time, resulting in poor accuracy during test-time. Err codemadness.org 70 i 6150 In this work, we identify the fundamental factors that give rise to this Err codemadness.org 70 i 6151 behavior, by explaining why models fail this way {\em even} in easy-to-learn Err codemadness.org 70 i 6152 tasks where one would expect these models to succeed. In particular, through a Err codemadness.org 70 i 6153 theoretical study of gradient-descent-trained linear classifiers on some Err codemadness.org 70 i 6154 easy-to-learn tasks, we uncover two complementary failure modes. These modes Err codemadness.org 70 i 6155 arise from how spurious correlations induce two kinds of skews in the data: one Err codemadness.org 70 i 6156 geometric in nature, and another, statistical in nature. Finally, we construct Err codemadness.org 70 i 6157 natural modifications of image classification datasets to understand when these Err codemadness.org 70 i 6158 failure modes can arise in practice. We also design experiments to isolate the Err codemadness.org 70 i 6159 two failure modes when training modern neural networks on these datasets. Err codemadness.org 70 i 6160

Err codemadness.org 70 i 6161

Quantum advantage for differential equation analysis. (arXiv:2010.15776v1 [quant-ph])

Quantum algorithms for both differential equation solving and for machine Err codemadness.org 70 i 6168 learning potentially offer an exponential speedup over all known classical Err codemadness.org 70 i 6169 algorithms. However, there also exist obstacles to obtaining this potential Err codemadness.org 70 i 6170 speedup in useful problem instances. The essential obstacle for quantum Err codemadness.org 70 i 6171 differential equation solving is that outputting useful information may require Err codemadness.org 70 i 6172 difficult post-processing, and the essential obstacle for quantum machine Err codemadness.org 70 i 6173 learning is that inputting the training set is a difficult task just by itself. Err codemadness.org 70 i 6174 In this paper, we demonstrate, when combined, these difficulties solve one Err codemadness.org 70 i 6175 another. We show how the output of quantum differential equation solving can Err codemadness.org 70 i 6176 serve as the input for quantum machine learning, allowing dynamical analysis in Err codemadness.org 70 i 6177 terms of principal components, power spectra, and wavelet decompositions. To Err codemadness.org 70 i 6178 illustrate this, we consider continuous time Markov processes on Err codemadness.org 70 i 6179 epidemiological and social networks. These quantum algorithms provide an Err codemadness.org 70 i 6180 exponential advantage over existing classical Monte Carlo methods. Err codemadness.org 70 i 6181

Err codemadness.org 70 i 6182

Contextual BERT: Conditioning the Language Model Using a Global State. (arXiv:2010.15778v1 [cs.CL])

BERT is a popular language model whose main pre-training task is to fill in Err codemadness.org 70 i 6189 the blank, i.e., predicting a word that was masked out of a sentence, based on Err codemadness.org 70 i 6190 the remaining words. In some applications, however, having an additional Err codemadness.org 70 i 6191 context can help the model make the right prediction, e.g., by taking the Err codemadness.org 70 i 6192 domain or the time of writing into account. This motivates us to advance the Err codemadness.org 70 i 6193 BERT architecture by adding a global state for conditioning on a fixed-sized Err codemadness.org 70 i 6194 context. We present our two novel approaches and apply them to an industry Err codemadness.org 70 i 6195 use-case, where we complete fashion outfits with missing articles, conditioned Err codemadness.org 70 i 6196 on a specific customer. An experimental comparison to other methods from the Err codemadness.org 70 i 6197 literature shows that our methods improve personalization significantly. Err codemadness.org 70 i 6198

Err codemadness.org 70 i 6199

Stable and efficient Petrov-Galerkin methods for a kinetic Fokker-Planck equation. (arXiv:2010.15784v1 [math.NA])

We propose a stable Petrov-Galerkin discretization of a kinetic Fokker-Planck Err codemadness.org 70 i 6206 equation constructed in such a way that uniform inf-sup stability can be Err codemadness.org 70 i 6207 inferred directly from the variational formulation. Inspired by well-posedness Err codemadness.org 70 i 6208 results for parabolic equations, we derive a lower bound for the dual inf-sup Err codemadness.org 70 i 6209 constant of the Fokker-Planck bilinear form by means of stable pairs of trial Err codemadness.org 70 i 6210 and test functions. The trial function of such a pair is constructed by Err codemadness.org 70 i 6211 applying the kinetic transport operator and the inverse velocity Err codemadness.org 70 i 6212 Laplace-Beltrami operator to a given test function. For the Petrov-Galerkin Err codemadness.org 70 i 6213 projection we choose an arbitrary discrete test space and then define the Err codemadness.org 70 i 6214 discrete trial space using the same application of transport and inverse Err codemadness.org 70 i 6215 Laplace-Beltrami operator. As a result, the spaces replicate the stable pairs Err codemadness.org 70 i 6216 of the continuous level and we obtain a well-posed numerical method with a Err codemadness.org 70 i 6217 discrete inf-sup constant identical to the inf-sup constant of the continuous Err codemadness.org 70 i 6218 problem independently of the mesh size. We show how the specific basis Err codemadness.org 70 i 6219 functions can be efficiently computed by low-dimensional elliptic problems, and Err codemadness.org 70 i 6220 confirm the practicability and performance of the method for a numerical Err codemadness.org 70 i 6221 example. Err codemadness.org 70 i 6222

Err codemadness.org 70 i 6223

Quickest detection of false data injection attack in remote state estimation. (arXiv:2010.15785v1 [eess.SY])

In this paper, quickest detection of false data injection attack on remote Err codemadness.org 70 i 6230 state estimation is considered. A set of $N$ sensors make noisy linear Err codemadness.org 70 i 6231 observations of a discrete-time linear process with Gaussian noise, and report Err codemadness.org 70 i 6232 the observations to a remote estimator. The challenge is the presence of a few Err codemadness.org 70 i 6233 potentially malicious sensors which can start strategically manipulating their Err codemadness.org 70 i 6234 observations at a random time in order to skew the estimates. The quickest Err codemadness.org 70 i 6235 attack detection problem for a known linear attack scheme is posed as a Err codemadness.org 70 i 6236 constrained Markov decision process in order to minimise the expected detection Err codemadness.org 70 i 6237 delay subject to a false alarm constraint, with the state involving the Err codemadness.org 70 i 6238 probability belief at the estimator that the system is under attack. State Err codemadness.org 70 i 6239 transition probabilities are derived in terms of system parameters, and the Err codemadness.org 70 i 6240 structure of the optimal policy is derived analytically. It turns out that the Err codemadness.org 70 i 6241 optimal policy amounts to checking whether the probability belief exceeds a Err codemadness.org 70 i 6242 threshold. Numerical results demonstrate significant performance gain under the Err codemadness.org 70 i 6243 proposed algorithm against competing algorithms. Err codemadness.org 70 i 6244

Err codemadness.org 70 i 6245

Light-Weight DDoS Mitigation at Network Edge with Limited Resources. (arXiv:2010.15786v1 [cs.NI])

The Internet of Things (IoT) has been growing rapidly in recent years. With Err codemadness.org 70 i 6252 the appearance of 5G, it is expected to become even more indispensable to Err codemadness.org 70 i 6253 people's lives. In accordance with the increase of Distributed Err codemadness.org 70 i 6254 Denial-of-Service (DDoS) attacks from IoT devices, DDoS defense has become a Err codemadness.org 70 i 6255 hot research topic. DDoS detection mechanisms executed on routers and SDN Err codemadness.org 70 i 6256 environments have been intensely studied. However, these methods have the Err codemadness.org 70 i 6257 disadvantage of requiring the cost and performance of the devices. In addition, Err codemadness.org 70 i 6258 there is no existing DDoS mitigation algorithm on the network edge that can be Err codemadness.org 70 i 6259 performed with the low-cost and low performance equipments. Therefore, this Err codemadness.org 70 i 6260 paper proposes a light-weight DDoS mitigation scheme at the network edge using Err codemadness.org 70 i 6261 limited resources of inexpensive devices such as home gateways. The goal of the Err codemadness.org 70 i 6262 proposed scheme is to simply detect and mitigate flooding attacks. It utilizes Err codemadness.org 70 i 6263 unused queue resources to detect malicious flows by random shuffling of queue Err codemadness.org 70 i 6264 allocation and discard the packets of the detected flows. The performance of Err codemadness.org 70 i 6265 the proposed scheme was confirmed via theoretical analysis and computer Err codemadness.org 70 i 6266 simulation. The simulation results match the theoretical results and the Err codemadness.org 70 i 6267 proposed algorithm can efficiently detect malicious flows using limited Err codemadness.org 70 i 6268 resources. Err codemadness.org 70 i 6269

Err codemadness.org 70 i 6270

A Framework for Learning Predator-prey Agents from Simulation to Real World. (arXiv:2010.15792v1 [cs.RO])

In this paper, we propose an evolutionary predatorprey robot system which can Err codemadness.org 70 i 6277 be generally implemented from simulation to the real world. We design the Err codemadness.org 70 i 6278 closed-loop robot system with camera and infrared sensors as inputs of Err codemadness.org 70 i 6279 controller. Both the predators and prey are co-evolved by NeuroEvolution of Err codemadness.org 70 i 6280 Augmenting Topologies (NEAT) to learn the expected behaviours. We design a Err codemadness.org 70 i 6281 framework that integrate Gym of OpenAI, Robot Operating System (ROS), Gazebo. Err codemadness.org 70 i 6282 In such a framework, users only need to focus on algorithms without being Err codemadness.org 70 i 6283 worried about the detail of manipulating robots in both simulation and the real Err codemadness.org 70 i 6284 world. Combining simulations, real-world evolution, and robustness analysis, it Err codemadness.org 70 i 6285 can be applied to develop the solutions for the predator-prey tasks. For the Err codemadness.org 70 i 6286 convenience of users, the source code and videos of the simulated and real Err codemadness.org 70 i 6287 world are published on Github. Err codemadness.org 70 i 6288

Err codemadness.org 70 i 6289

A computational periporomechanics model for localized failure in unsaturated porous media. (arXiv:2010.15793v1 [math.NA])

We implement a computational periporomechanics model for simulating localized Err codemadness.org 70 i 6296 failure in unsaturated porous media. The coupled periporomechanics model is Err codemadness.org 70 i 6297 based on the peridynamic state concept and the effective force state concept. Err codemadness.org 70 i 6298 The coupled governing equations are integral-differential equations without Err codemadness.org 70 i 6299 assuming the continuity of solid displacement and fluid pressures. The fluid Err codemadness.org 70 i 6300 flow and effective force states are determined by nonlocal fluid pressure and Err codemadness.org 70 i 6301 deformation gradients through the recently formulated multiphase constitutive Err codemadness.org 70 i 6302 correspondence principle. The coupled peri-poromechanics is implemented Err codemadness.org 70 i 6303 numerically for high-performance computing by an implicit multiphase meshfree Err codemadness.org 70 i 6304 method utilizing the message passing interface. The numerical implementation is Err codemadness.org 70 i 6305 validated by simulating classical poromechanics problems and comparing the Err codemadness.org 70 i 6306 numerical results with analytical solutions and experimental data. Numerical Err codemadness.org 70 i 6307 examples are presented to demonstrate the robustness of the fully coupled Err codemadness.org 70 i 6308 peri-poromechanics in modeling localized failures in unsaturated porous media. Err codemadness.org 70 i 6309

Err codemadness.org 70 i 6310

Eccentricity queries and beyond using Hub Labels. (arXiv:2010.15794v1 [cs.DS])

Hub labeling schemes are popular methods for computing distances on road Err codemadness.org 70 i 6317 networks and other large complex networks, often answering to a query within a Err codemadness.org 70 i 6318 few microseconds for graphs with millions of edges. In this work, we study Err codemadness.org 70 i 6319 their algorithmic applications beyond distance queries. We focus on Err codemadness.org 70 i 6320 eccentricity queries and distance-sum queries, for several versions of these Err codemadness.org 70 i 6321 problems on directed weighted graphs, that is in part motivated by their Err codemadness.org 70 i 6322 importance in facility location problems. On the negative side, we show Err codemadness.org 70 i 6323 conditional lower bounds for these above problems on unweighted undirected Err codemadness.org 70 i 6324 sparse graphs, via standard constructions from "Fine-grained" complexity. Err codemadness.org 70 i 6325 However, things take a different turn when the hub labels have a sublogarithmic Err codemadness.org 70 i 6326 size. Indeed, given a hub labeling of maximum label size $\leq k$, after Err codemadness.org 70 i 6327 pre-processing the labels in total $2^{{O}(k)} \cdot |V|^{1+o(1)}$ time, we can Err codemadness.org 70 i 6328 compute both the eccentricity and the distance-sum of any vertex in $2^{{O}(k)} Err codemadness.org 70 i 6329 \cdot |V|^{o(1)}$ time. It can also be applied to the fast global computation Err codemadness.org 70 i 6330 of some topological indices. Finally, as a by-product of our approach, on any Err codemadness.org 70 i 6331 fixed class of unweighted graphs with bounded expansion, we can decide whether Err codemadness.org 70 i 6332 the diameter of an $n$-vertex graph in the class is at most $k$ in $f(k) \cdot Err codemadness.org 70 i 6333 n^{1+o(1)}$ time, for some "explicit" function $f$. Err codemadness.org 70 i 6334

Err codemadness.org 70 i 6335

Ray-marching Thurston geometries. (arXiv:2010.15801v1 [math.GT])

We describe algorithms that produce accurate real-time interactive in-space Err codemadness.org 70 i 6342 views of the eight Thurston geometries using ray-marching. We give a Err codemadness.org 70 i 6343 theoretical framework for our algorithms, independent of the geometry involved. Err codemadness.org 70 i 6344 In addition to scenes within a geometry $X$, we also consider scenes within Err codemadness.org 70 i 6345 quotient manifolds and orbifolds $X / \Gamma$. We adapt the Phong lighting Err codemadness.org 70 i 6346 model to non-euclidean geometries. The most difficult part of this is the Err codemadness.org 70 i 6347 calculation of light intensity, which relates to the area density of geodesic Err codemadness.org 70 i 6348 spheres. We also give extensive practical details for each geometry. Err codemadness.org 70 i 6349

Err codemadness.org 70 i 6350

Isometric embeddings in trees and their use in the diameter problem. (arXiv:2010.15803v1 [cs.DS])

We prove that given a discrete space with $n$ points which is either embedded Err codemadness.org 70 i 6357 in a system of $k$ trees, or the Cartesian product of $k$ trees, we can compute Err codemadness.org 70 i 6358 all eccentricities in ${\cal O}(2^{{\cal O}(k\log{k})}(N+n)^{1+o(1)})$ time, Err codemadness.org 70 i 6359 where $N$ is the cumulative total order over all these $k$ trees. This is near Err codemadness.org 70 i 6360 optimal under the Strong Exponential-Time Hypothesis, even in the very special Err codemadness.org 70 i 6361 case of an $n$-vertex graph embedded in a system of $\omega(\log{n})$ spanning Err codemadness.org 70 i 6362 trees. However, given such an embedding in the strong product of $k$ trees, Err codemadness.org 70 i 6363 there is a much faster ${\cal O}(N + kn)$-time algorithm for this problem. All Err codemadness.org 70 i 6364 our positive results can be turned into approximation algorithms for the graphs Err codemadness.org 70 i 6365 and finite spaces with a quasi isometric embedding in trees, if such embedding Err codemadness.org 70 i 6366 is given as input, where the approximation factor (resp., the approximation Err codemadness.org 70 i 6367 constant) depends on the distortion of the embedding (resp., of its stretch). Err codemadness.org 70 i 6368 The existence of embeddings in the Cartesian product of finitely many trees has Err codemadness.org 70 i 6369 been thoroughly investigated for cube-free median graphs. We give the Err codemadness.org 70 i 6370 first-known quasi linear-time algorithm for computing the diameter within this Err codemadness.org 70 i 6371 graph class. It does not require an embedding in a product of trees to be given Err codemadness.org 70 i 6372 as part of the input. On our way, being given an $n$-node tree $T$, we propose Err codemadness.org 70 i 6373 a data structure with ${\cal O}(n\log{n})$ pre-processing time in order to Err codemadness.org 70 i 6374 compute in ${\cal O}(k\log^2{n})$ time the eccentricity of any subset of $k$ Err codemadness.org 70 i 6375 nodes. We combine the latter technical contribution, of independent interest, Err codemadness.org 70 i 6376 with a recent distance-labeling scheme that was designed for cube-free median Err codemadness.org 70 i 6377 graphs. Err codemadness.org 70 i 6378

Err codemadness.org 70 i 6379

A Local Search Framework for Experimental Design. (arXiv:2010.15805v1 [cs.DS])

We present a local search framework to design and analyze both combinatorial Err codemadness.org 70 i 6386 algorithms and rounding algorithms for experimental design problems. This Err codemadness.org 70 i 6387 framework provides a unifying approach to match and improve all known results Err codemadness.org 70 i 6388 in D/A/E-design and to obtain new results in previously unknown settings. Err codemadness.org 70 i 6389

Err codemadness.org 70 i 6390

For combinatorial algorithms, we provide a new analysis of the classical Err codemadness.org 70 i 6391 Fedorov's exchange method. We prove that this simple local search algorithm Err codemadness.org 70 i 6392 works well as long as there exists an almost optimal solution with good Err codemadness.org 70 i 6393 condition number. Moreover, we design a new combinatorial local search Err codemadness.org 70 i 6394 algorithm for E-design using the regret minimization framework. Err codemadness.org 70 i 6395

Err codemadness.org 70 i 6396

For rounding algorithms, we provide a unified randomized exchange algorithm Err codemadness.org 70 i 6397 to match and improve previous results for D/A/E-design. Furthermore, the Err codemadness.org 70 i 6398 algorithm works in the more general setting to approximately satisfy multiple Err codemadness.org 70 i 6399 knapsack constraints, which can be used for weighted experimental design and Err codemadness.org 70 i 6400 for incorporating fairness constraints into experimental design. Err codemadness.org 70 i 6401

Err codemadness.org 70 i 6402

The ins and outs of speaker recognition: lessons from VoxSRC 2020. (arXiv:2010.15809v1 [cs.SD])

The VoxCeleb Speaker Recognition Challenge (VoxSRC) at Interspeech 2020 Err codemadness.org 70 i 6409 offers a challenging evaluation for speaker recognition systems, which includes Err codemadness.org 70 i 6410 celebrities playing different parts in movies. The goal of this work is robust Err codemadness.org 70 i 6411 speaker recognition of utterances recorded in these challenging environments. Err codemadness.org 70 i 6412 We utilise variants of the popular ResNet architecture for speaker recognition Err codemadness.org 70 i 6413 and perform extensive experiments using a range of loss functions and training Err codemadness.org 70 i 6414 parameters. To this end, we optimise an efficient training framework that Err codemadness.org 70 i 6415 allows powerful models to be trained with limited time and resources. Our Err codemadness.org 70 i 6416 trained models demonstrate improvements over most existing works with lighter Err codemadness.org 70 i 6417 models and a simple pipeline. The paper shares the lessons learned from our Err codemadness.org 70 i 6418 participation in the challenge. Err codemadness.org 70 i 6419

Err codemadness.org 70 i 6420

Algorithmic pure states for the negative spherical perceptron. (arXiv:2010.15811v1 [math.PR])

We consider the spherical perceptron with Gaussian disorder. This is the set Err codemadness.org 70 i 6427 $S$ of points $\sigma \in \mathbb{R}^N$ on the sphere of radius $\sqrt{N}$ Err codemadness.org 70 i 6428 satisfying $\langle g_a , \sigma \rangle \ge \kappa\sqrt{N}\,$ for all $1 \le a Err codemadness.org 70 i 6429 \le M$, where $(g_a)_{a=1}^M$ are independent standard gaussian vectors and Err codemadness.org 70 i 6430 $\kappa \in \mathbb{R}$ is fixed. Various characteristics of $S$ such as its Err codemadness.org 70 i 6431 surface measure and the largest $M$ for which it is non-empty, were computed Err codemadness.org 70 i 6432 heuristically in statistical physics in the asymptotic regime $N \to \infty$, Err codemadness.org 70 i 6433 $M/N \to \alpha$. The case $\kappa<0$ is of special interest as $S$ is Err codemadness.org 70 i 6434 conjectured to exhibit a hierarchical tree-like geometry known as "full Err codemadness.org 70 i 6435 replica-symmetry breaking" (FRSB) close to the satisfiability threshold Err codemadness.org 70 i 6436 $\alpha_{\text{SAT}}(\kappa)$, and whose characteristics are captured by a Err codemadness.org 70 i 6437 Parisi variational principle akin to the one appearing in the Err codemadness.org 70 i 6438 Sherrington-Kirkpatrick model. In this paper we design an efficient algorithm Err codemadness.org 70 i 6439 which, given oracle access to the solution of the Parisi variational principle, Err codemadness.org 70 i 6440 exploits this conjectured FRSB structure for $\kappa<0$ and outputs a vector Err codemadness.org 70 i 6441 $\hat{\sigma}$ satisfying $\langle g_a , \hat{\sigma}\rangle \ge \kappa Err codemadness.org 70 i 6442 \sqrt{N}$ for all $1\le a \le M$ and lying on a sphere of non-trivial radius Err codemadness.org 70 i 6443 $\sqrt{\bar{q} N}$, where $\bar{q} \in (0,1)$ is the right-end of the support Err codemadness.org 70 i 6444 of the associated Parisi measure. We expect $\hat{\sigma}$ to be approximately Err codemadness.org 70 i 6445 the barycenter of a pure state of the spherical perceptron. Moreover we expect Err codemadness.org 70 i 6446 that $\bar{q} \to 1$ as $\alpha \to \alpha_{\text{SAT}}(\kappa)$, so that Err codemadness.org 70 i 6447 $\big\langle g_a,\hat{\sigma}/|\hat{\sigma}|\big\rangle \geq Err codemadness.org 70 i 6448 (\kappa-o(1))\sqrt{N}$ near criticality. Err codemadness.org 70 i 6449

Err codemadness.org 70 i 6450

Around the diameter of AT-free graphs. (arXiv:2010.15814v1 [cs.DS])

A graph algorithm is truly subquadratic if it runs in ${\cal O}(m^b)$ time on Err codemadness.org 70 i 6457 connected $m$-edge graphs, for some positive $b < 2$. Roditty and Vassilevska Err codemadness.org 70 i 6458 Williams (STOC'13) proved that under plausible complexity assumptions, there is Err codemadness.org 70 i 6459 no truly subquadratic algorithm for computing the diameter of general graphs. Err codemadness.org 70 i 6460 In this work, we present positive and negative results on the existence of such Err codemadness.org 70 i 6461 algorithms for computing the diameter on some special graph classes. Err codemadness.org 70 i 6462 Specifically, three vertices in a graph form an asteroidal triple (AT) if Err codemadness.org 70 i 6463 between any two of them there exists a path that avoids the closed Err codemadness.org 70 i 6464 neighbourhood of the third one. We call a graph AT-free if it does not contain Err codemadness.org 70 i 6465 an AT. We first prove that for all $m$-edge AT-free graphs, one can compute all Err codemadness.org 70 i 6466 the eccentricities in truly subquadratic ${\cal O}(m^{3/2})$ time. Then, we Err codemadness.org 70 i 6467 extend our study to several subclasses of chordal graphs -- all of them Err codemadness.org 70 i 6468 generalizing interval graphs in various ways --, as an attempt to understand Err codemadness.org 70 i 6469 which of the properties of AT-free graphs, or natural generalizations of the Err codemadness.org 70 i 6470 latter, can help in the design of fast algorithms for the diameter problem on Err codemadness.org 70 i 6471 broader graph classes. For instance, for all chordal graphs with a dominating Err codemadness.org 70 i 6472 shortest path, there is a linear-time algorithm for computing a diametral pair Err codemadness.org 70 i 6473 if the diameter is at least four. However, already for split graphs with a Err codemadness.org 70 i 6474 dominating edge, under plausible complexity assumptions, there is no truly Err codemadness.org 70 i 6475 subquadratic algorithm for deciding whether the diameter is either $2$ or $3$. Err codemadness.org 70 i 6476

Err codemadness.org 70 i 6477

Tensor Completion via Tensor Networks with a Tucker Wrapper. (arXiv:2010.15819v1 [stat.ML])

In recent years, low-rank tensor completion (LRTC) has received considerable Err codemadness.org 70 i 6484 attention due to its applications in image/video inpainting, hyperspectral data Err codemadness.org 70 i 6485 recovery, etc. With different notions of tensor rank (e.g., CP, Tucker, tensor Err codemadness.org 70 i 6486 train/ring, etc.), various optimization based numerical methods are proposed to Err codemadness.org 70 i 6487 LRTC. However, tensor network based methods have not been proposed yet. In this Err codemadness.org 70 i 6488 paper, we propose to solve LRTC via tensor networks with a Tucker wrapper. Here Err codemadness.org 70 i 6489 by "Tucker wrapper" we mean that the outermost factor matrices of the tensor Err codemadness.org 70 i 6490 network are all orthonormal. We formulate LRTC as a problem of solving a system Err codemadness.org 70 i 6491 of nonlinear equations, rather than a constrained optimization problem. A Err codemadness.org 70 i 6492 two-level alternative least square method is then employed to update the Err codemadness.org 70 i 6493 unknown factors. The computation of the method is dominated by tensor matrix Err codemadness.org 70 i 6494 multiplications and can be efficiently performed. Also, under proper Err codemadness.org 70 i 6495 assumptions, it is shown that with high probability, the method converges to Err codemadness.org 70 i 6496 the exact solution at a linear rate. Numerical simulations show that the Err codemadness.org 70 i 6497 proposed algorithm is comparable with state-of-the-art methods. Err codemadness.org 70 i 6498

Err codemadness.org 70 i 6499

Down the bot hole: actionable insights from a 1-year analysis of bots activity on Twitter. (arXiv:2010.15820v1 [cs.SI])

Nowadays, social media represent persuasive tools that have been Err codemadness.org 70 i 6506 progressively weaponized to affect people's beliefs, spread manipulative Err codemadness.org 70 i 6507 narratives, and sow conflicts along divergent factions. Software-controlled Err codemadness.org 70 i 6508 accounts (i.e., bots) are one of the main actors associated with manipulation Err codemadness.org 70 i 6509 campaigns, especially in the political context. Uncovering the strategies Err codemadness.org 70 i 6510 behind bots' activities is of paramount importance to detect and curb such Err codemadness.org 70 i 6511 campaigns. In this paper, we present a long term (one year) analysis of bots Err codemadness.org 70 i 6512 activity on Twitter in the run-up to the 2018 U.S. Midterm Elections. We Err codemadness.org 70 i 6513 identify different classes of accounts based on their nature (bot vs. human) Err codemadness.org 70 i 6514 and engagement within the online discussion and we observe that hyperactive Err codemadness.org 70 i 6515 bots played a pivotal role in the dissemination of conspiratorial narratives, Err codemadness.org 70 i 6516 while dominating the political debate since the year before the election. Our Err codemadness.org 70 i 6517 analysis, on the horizon of the upcoming U.S. 2020 Presidential Election, Err codemadness.org 70 i 6518 reveals both alarming findings of humans' susceptibility to bots and actionable Err codemadness.org 70 i 6519 insights that can contribute to curbing coordinated campaigns. Err codemadness.org 70 i 6520

Err codemadness.org 70 i 6521

Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search. (arXiv:2010.15821v1 [cs.CV])

One-shot weight sharing methods have recently drawn great attention in neural Err codemadness.org 70 i 6528 architecture search due to high efficiency and competitive performance. Err codemadness.org 70 i 6529 However, weight sharing across models has an inherent deficiency, i.e., Err codemadness.org 70 i 6530 insufficient training of subnetworks in the hypernetwork. To alleviate this Err codemadness.org 70 i 6531 problem, we present a simple yet effective architecture distillation method. Err codemadness.org 70 i 6532 The central idea is that subnetworks can learn collaboratively and teach each Err codemadness.org 70 i 6533 other throughout the training process, aiming to boost the convergence of Err codemadness.org 70 i 6534 individual models. We introduce the concept of prioritized path, which refers Err codemadness.org 70 i 6535 to the architecture candidates exhibiting superior performance during training. Err codemadness.org 70 i 6536 Distilling knowledge from the prioritized paths is able to boost the training Err codemadness.org 70 i 6537 of subnetworks. Since the prioritized paths are changed on the fly depending on Err codemadness.org 70 i 6538 their performance and complexity, the final obtained paths are the cream of the Err codemadness.org 70 i 6539 crop. We directly select the most promising one from the prioritized paths as Err codemadness.org 70 i 6540 the final architecture, without using other complex search methods, such as Err codemadness.org 70 i 6541 reinforcement learning or evolution algorithms. The experiments on ImageNet Err codemadness.org 70 i 6542 verify such path distillation method can improve the convergence ratio and Err codemadness.org 70 i 6543 performance of the hypernetwork, as well as boosting the training of Err codemadness.org 70 i 6544 subnetworks. The discovered architectures achieve superior performance compared Err codemadness.org 70 i 6545 to the recent MobileNetV3 and EfficientNet families under aligned settings. Err codemadness.org 70 i 6546 Moreover, the experiments on object detection and more challenging search space Err codemadness.org 70 i 6547 show the generality and robustness of the proposed method. Code and models are Err codemadness.org 70 i 6548 available at https://github.com/microsoft/cream.git. Err codemadness.org 70 i 6549

Err codemadness.org 70 i 6550

Black-Box Optimization of Object Detector Scales. (arXiv:2010.15823v1 [cs.CV])

Object detectors have improved considerably in the last years by using Err codemadness.org 70 i 6557 advanced CNN architectures. However, many detector hyper-parameters are Err codemadness.org 70 i 6558 generally manually tuned, or they are used with values set by the detector Err codemadness.org 70 i 6559 authors. Automatic Hyper-parameter optimization has not been explored in Err codemadness.org 70 i 6560 improving CNN-based object detectors hyper-parameters. In this work, we propose Err codemadness.org 70 i 6561 the use of Black-box optimization methods to tune the prior/default box scales Err codemadness.org 70 i 6562 in Faster R-CNN and SSD, using Bayesian Optimization, SMAC, and CMA-ES. We show Err codemadness.org 70 i 6563 that by tuning the input image size and prior box anchor scale on Faster R-CNN Err codemadness.org 70 i 6564 mAP increases by 2% on PASCAL VOC 2007, and by 3% with SSD. On the COCO dataset Err codemadness.org 70 i 6565 with SSD there are mAP improvement in the medium and large objects, but mAP Err codemadness.org 70 i 6566 decreases by 1% in small objects. We also perform a regression analysis to find Err codemadness.org 70 i 6567 the significant hyper-parameters to tune. Err codemadness.org 70 i 6568

Err codemadness.org 70 i 6569

Passport-aware Normalization for Deep Model Protection. (arXiv:2010.15824v1 [cs.CV])

Despite tremendous success in many application scenarios, deep learning faces Err codemadness.org 70 i 6576 serious intellectual property (IP) infringement threats. Considering the cost Err codemadness.org 70 i 6577 of designing and training a good model, infringements will significantly Err codemadness.org 70 i 6578 infringe the interests of the original model owner. Recently, many impressive Err codemadness.org 70 i 6579 works have emerged for deep model IP protection. However, they either are Err codemadness.org 70 i 6580 vulnerable to ambiguity attacks, or require changes in the target network Err codemadness.org 70 i 6581 structure by replacing its original normalization layers and hence cause Err codemadness.org 70 i 6582 significant performance drops. To this end, we propose a new passport-aware Err codemadness.org 70 i 6583 normalization formulation, which is generally applicable to most existing Err codemadness.org 70 i 6584 normalization layers and only needs to add another passport-aware branch for IP Err codemadness.org 70 i 6585 protection. This new branch is jointly trained with the target model but Err codemadness.org 70 i 6586 discarded in the inference stage. Therefore it causes no structure change in Err codemadness.org 70 i 6587 the target model. Only when the model IP is suspected to be stolen by someone, Err codemadness.org 70 i 6588 the private passport-aware branch is added back for ownership verification. Err codemadness.org 70 i 6589 Through extensive experiments, we verify its effectiveness in both image and 3D Err codemadness.org 70 i 6590 point recognition models. It is demonstrated to be robust not only to common Err codemadness.org 70 i 6591 attack techniques like fine-tuning and model compression, but also to ambiguity Err codemadness.org 70 i 6592 attacks. By further combining it with trigger-set based methods, both black-box Err codemadness.org 70 i 6593 and white-box verification can be achieved for enhanced security of deep Err codemadness.org 70 i 6594 learning models deployed in real systems. Code can be found at Err codemadness.org 70 i 6595 https://github.com/ZJZAC/Passport-aware-Normalization. Err codemadness.org 70 i 6596

Err codemadness.org 70 i 6597

RelationNet++: Bridging Visual Representations for Object Detection via Transformer Decoder. (arXiv:2010.15831v1 [cs.CV])

Existing object detection frameworks are usually built on a single format of Err codemadness.org 70 i 6604 object/part representation, i.e., anchor/proposal rectangle boxes in RetinaNet Err codemadness.org 70 i 6605 and Faster R-CNN, center points in FCOS and RepPoints, and corner points in Err codemadness.org 70 i 6606 CornerNet. While these different representations usually drive the frameworks Err codemadness.org 70 i 6607 to perform well in different aspects, e.g., better classification or finer Err codemadness.org 70 i 6608 localization, it is in general difficult to combine these representations in a Err codemadness.org 70 i 6609 single framework to make good use of each strength, due to the heterogeneous or Err codemadness.org 70 i 6610 non-grid feature extraction by different representations. This paper presents Err codemadness.org 70 i 6611 an attention-based decoder module similar as that in Err codemadness.org 70 i 6612 Transformer~\cite{vaswani2017attention} to bridge other representations into a Err codemadness.org 70 i 6613 typical object detector built on a single representation format, in an Err codemadness.org 70 i 6614 end-to-end fashion. The other representations act as a set of \emph{key} Err codemadness.org 70 i 6615 instances to strengthen the main \emph{query} representation features in the Err codemadness.org 70 i 6616 vanilla detectors. Novel techniques are proposed towards efficient computation Err codemadness.org 70 i 6617 of the decoder module, including a \emph{key sampling} approach and a Err codemadness.org 70 i 6618 \emph{shared location embedding} approach. The proposed module is named Err codemadness.org 70 i 6619 \emph{bridging visual representations} (BVR). It can perform in-place and we Err codemadness.org 70 i 6620 demonstrate its broad effectiveness in bridging other representations into Err codemadness.org 70 i 6621 prevalent object detection frameworks, including RetinaNet, Faster R-CNN, FCOS Err codemadness.org 70 i 6622 and ATSS, where about $1.5\sim3.0$ AP improvements are achieved. In particular, Err codemadness.org 70 i 6623 we improve a state-of-the-art framework with a strong backbone by about $2.0$ Err codemadness.org 70 i 6624 AP, reaching $52.7$ AP on COCO test-dev. The resulting network is named Err codemadness.org 70 i 6625 RelationNet++. The code will be available at Err codemadness.org 70 i 6626 https://github.com/microsoft/RelationNet2. Err codemadness.org 70 i 6627

Err codemadness.org 70 i 6628

Proceedings 9th International Workshop on Theorem Proving Components for Educational Software. (arXiv:2010.15832v1 [cs.AI])

The 9th International Workshop on Theorem-Proving Components for Educational Err codemadness.org 70 i 6635 Software (ThEdu'20) was scheduled to happen on June 29 as a satellite of the Err codemadness.org 70 i 6636 IJCAR-FSCD 2020 joint meeting, in Paris. The COVID-19 pandemic came by Err codemadness.org 70 i 6637 surprise, though, and the main conference was virtualised. Fearing that an Err codemadness.org 70 i 6638 online meeting would not allow our community to fully reproduce the usual Err codemadness.org 70 i 6639 face-to-face networking opportunities of the ThEdu initiative, the Steering Err codemadness.org 70 i 6640 Committee of ThEdu decided to cancel our workshop. Given that many of us had Err codemadness.org 70 i 6641 already planned and worked for that moment, we decided that ThEdu'20 could Err codemadness.org 70 i 6642 still live in the form of an EPTCS volume. The EPTCS concurred with us, Err codemadness.org 70 i 6643 recognising this very singular situation, and accepted our proposal of Err codemadness.org 70 i 6644 organising a special issue with papers submitted to ThEdu'20. An open call for Err codemadness.org 70 i 6645 papers was then issued, and attracted five submissions, all of which have been Err codemadness.org 70 i 6646 accepted by our reviewers, who produced three careful reports on each of the Err codemadness.org 70 i 6647 contributions. The resulting revised papers are collected in the present Err codemadness.org 70 i 6648 volume. We, the volume editors, hope that this collection of papers will help Err codemadness.org 70 i 6649 further promoting the development of theorem-proving-based software, and that Err codemadness.org 70 i 6650 it will collaborate to improve the mutual understanding between computer Err codemadness.org 70 i 6651 mathematicians and stakeholders in education. With some luck, we would actually Err codemadness.org 70 i 6652 expect that the very special circumstances set up by the worst sanitary crisis Err codemadness.org 70 i 6653 in a century will happen to reinforce the need for the application of certified Err codemadness.org 70 i 6654 components and of verification methods for the production of educational Err codemadness.org 70 i 6655 software that would be available even when the traditional on-site learning Err codemadness.org 70 i 6656 experiences turn out not to be recommendable. Err codemadness.org 70 i 6657

Err codemadness.org 70 i 6658

Property Checking Without Invariant Generation. (arXiv:1602.05829v3 [cs.LO] UPDATED)

We introduce a procedure for proving safety properties. This procedure is Err codemadness.org 70 i 6665 based on a technique called Partial Quantifier Elimination (PQE). In contrast Err codemadness.org 70 i 6666 to complete quantifier elimination, in PQE, only a part of the formula is taken Err codemadness.org 70 i 6667 out of the scope of quantifiers. So, PQE can be dramatically more efficient Err codemadness.org 70 i 6668 than complete quantifier elimination. The appeal of our procedure is twofold. Err codemadness.org 70 i 6669 First, it can prove a property without generating an inductive invariant. Err codemadness.org 70 i 6670 Second, it employs depth-first search and so can be used to find deep bugs. Err codemadness.org 70 i 6671

Err codemadness.org 70 i 6672

Minimax Rate-Optimal Estimation of Divergences between Discrete Distributions. (arXiv:1605.09124v4 [cs.IT] UPDATED)

We study the minimax estimation of $\alpha$-divergences between discrete Err codemadness.org 70 i 6679 distributions for integer $\alpha\ge 1$, which include the Kullback--Leibler Err codemadness.org 70 i 6680 divergence and the $\chi^2$-divergences as special examples. Dropping the usual Err codemadness.org 70 i 6681 theoretical tricks to acquire independence, we construct the first minimax Err codemadness.org 70 i 6682 rate-optimal estimator which does not require any Poissonization, sample Err codemadness.org 70 i 6683 splitting, or explicit construction of approximating polynomials. The estimator Err codemadness.org 70 i 6684 uses a hybrid approach which solves a problem-independent linear program based Err codemadness.org 70 i 6685 on moment matching in the non-smooth regime, and applies a problem-dependent Err codemadness.org 70 i 6686 bias-corrected plug-in estimator in the smooth regime, with a soft decision Err codemadness.org 70 i 6687 boundary between these regimes. Err codemadness.org 70 i 6688

Err codemadness.org 70 i 6689

Sequence Graph Transform (SGT): A Feature Embedding Function for Sequence Data Mining. (arXiv:1608.03533v13 [stat.ML] UPDATED)

Sequence feature embedding is a challenging task due to un-structuredness of Err codemadness.org 70 i 6696 sequences -- arbitrary strings of arbitrary length. Existing methods are Err codemadness.org 70 i 6697 efficient in extracting short-term dependencies but typically suffer from Err codemadness.org 70 i 6698 computation issues for the long-term. Sequence Graph Transform (SGT), a feature Err codemadness.org 70 i 6699 embedding function, that can extract any amount of short- to long- term Err codemadness.org 70 i 6700 dependencies without increasing the computation -- proved theoretically -- is Err codemadness.org 70 i 6701 proposed. SGT features yield significantly superior results in sequence Err codemadness.org 70 i 6702 clustering and classification with higher accuracy and lower computation as Err codemadness.org 70 i 6703 compared to the existing methods, including the state-of-the-art Err codemadness.org 70 i 6704 sequence/string Kernels and LSTM. Err codemadness.org 70 i 6705

Err codemadness.org 70 i 6706

Time-Space Trade-Offs for Computing Euclidean Minimum Spanning Trees. (arXiv:1712.06431v3 [cs.CG] UPDATED)

We present time-space trade-offs for computing the Euclidean minimum spanning Err codemadness.org 70 i 6713 tree of a set $S$ of $n$ point-sites in the plane. More precisely, we assume Err codemadness.org 70 i 6714 that $S$ resides in a random-access memory that can only be read. The edges of Err codemadness.org 70 i 6715 the Euclidean minimum spanning tree $\text{EMST}(S)$ have to be reported Err codemadness.org 70 i 6716 sequentially, and they cannot be accessed or modified afterwards. There is a Err codemadness.org 70 i 6717 parameter $s \in \{1, \dots, n\}$ so that the algorithm may use $O(s)$ cells of Err codemadness.org 70 i 6718 read-write memory (called the workspace) for its computations. Our goal is to Err codemadness.org 70 i 6719 find an algorithm that has the best possible running time for any given $s$ Err codemadness.org 70 i 6720 between $1$ and $n$. Err codemadness.org 70 i 6721

Err codemadness.org 70 i 6722

We show how to compute $\text{EMST}(S)$ in $O\big((n^3/s^2)\log s \big)$ time Err codemadness.org 70 i 6723 with $O(s)$ cells of workspace, giving a smooth trade-off between the two best Err codemadness.org 70 i 6724 known bounds $O(n^3)$ for $s = 1$ and $O(n \log n)$ for $s = n$. For this, we Err codemadness.org 70 i 6725 run Kruskal's algorithm on the relative neighborhood graph (RNG) of $S$. It is Err codemadness.org 70 i 6726 a classic fact that the minimum spanning tree of $\text{RNG}(S)$ is exactly Err codemadness.org 70 i 6727 $\text{EMST}(S)$. To implement Kruskal's algorithm with $O(s)$ cells of Err codemadness.org 70 i 6728 workspace, we define $s$-nets, a compact representation of planar graphs. This Err codemadness.org 70 i 6729 allows us to efficiently maintain and update the components of the current Err codemadness.org 70 i 6730 minimum spanning forest as the edges are being inserted. Err codemadness.org 70 i 6731

Err codemadness.org 70 i 6732

Type-two polynomial-time and restricted lookahead. (arXiv:1801.07485v2 [cs.CC] UPDATED)

This paper provides an alternate characterization of type-two polynomial-time Err codemadness.org 70 i 6739 computability, with the goal of making second-order complexity theory more Err codemadness.org 70 i 6740 approachable. We rely on the usual oracle machines to model programs with Err codemadness.org 70 i 6741 subroutine calls. In contrast to previous results, the use of higher-order Err codemadness.org 70 i 6742 objects as running times is avoided, either explicitly or implicitly. Instead, Err codemadness.org 70 i 6743 regular polynomials are used. This is achieved by refining the notion of Err codemadness.org 70 i 6744 oracle-polynomial-time introduced by Cook. We impose a further restriction on Err codemadness.org 70 i 6745 the oracle interactions to force feasibility. Both the restriction as well as Err codemadness.org 70 i 6746 its purpose are very simple: it is well-known that Cook's model allows Err codemadness.org 70 i 6747 polynomial depth iteration of functional inputs with no restrictions on size, Err codemadness.org 70 i 6748 and thus does not guarantee that polynomial-time computability is preserved. To Err codemadness.org 70 i 6749 mend this we restrict the number of lookahead revisions, that is the number of Err codemadness.org 70 i 6750 times a query can be asked that is bigger than any of the previous queries. We Err codemadness.org 70 i 6751 prove that this leads to a class of feasible functionals and that all feasible Err codemadness.org 70 i 6752 problems can be solved within this class if one is allowed to separate a task Err codemadness.org 70 i 6753 into efficiently solvable subtasks. Formally put: the closure of our class Err codemadness.org 70 i 6754 under lambda-abstraction and application includes all feasible operations. We Err codemadness.org 70 i 6755 also revisit the very similar class of strongly polynomial-time computable Err codemadness.org 70 i 6756 operators previously introduced by Kawamura and Steinberg. We prove it to be Err codemadness.org 70 i 6757 strictly included in our class and, somewhat surprisingly, to have the same Err codemadness.org 70 i 6758 closure property. This can be attributed to properties of the limited recursion Err codemadness.org 70 i 6759 operator: It is not strongly polynomial-time computable but decomposes into two Err codemadness.org 70 i 6760 such operations and lies in our class. Err codemadness.org 70 i 6761

Err codemadness.org 70 i 6762

Comparing Type Systems for Deadlock Freedom. (arXiv:1810.00635v3 [cs.LO] UPDATED)

Message-passing software systems exhibit non-trivial forms of concurrency and Err codemadness.org 70 i 6769 distribution; they are expected to follow intended protocols among Err codemadness.org 70 i 6770 communicating services, but also to never "get stuck". This intuitive Err codemadness.org 70 i 6771 requirement has been expressed by liveness properties such as progress or Err codemadness.org 70 i 6772 (dead)lock freedom and various type systems ensure these properties for Err codemadness.org 70 i 6773 concurrent processes. Unfortunately, very little is known about the precise Err codemadness.org 70 i 6774 relationship between these type systems and the classes of typed processes they Err codemadness.org 70 i 6775 induce. Err codemadness.org 70 i 6776

Err codemadness.org 70 i 6777

This paper puts forward the first comparative study of different type systems Err codemadness.org 70 i 6778 for message-passing processes that guarantee deadlock freedom. We compare two Err codemadness.org 70 i 6779 classes of deadlock-free typed processes, here denoted L and K. The class L Err codemadness.org 70 i 6780 stands out for its canonicity: it results from Curry-Howard interpretations of Err codemadness.org 70 i 6781 linear logic propositions as session types. The class K, obtained by encoding Err codemadness.org 70 i 6782 session types into Kobayashi's linear types with usages, includes processes not Err codemadness.org 70 i 6783 typable in other type systems. We show that L is strictly included in K, and Err codemadness.org 70 i 6784 identify the precise conditions under which they coincide. We also provide two Err codemadness.org 70 i 6785 type-preserving translations of processes in K into processes in L. Err codemadness.org 70 i 6786

Err codemadness.org 70 i 6787

AADS: Augmented Autonomous Driving Simulation using Data-driven Algorithms. (arXiv:1901.07849v3 [cs.CV] UPDATED)

Simulation systems have become an essential component in the development and Err codemadness.org 70 i 6794 validation of autonomous driving technologies. The prevailing state-of-the-art Err codemadness.org 70 i 6795 approach for simulation is to use game engines or high-fidelity computer Err codemadness.org 70 i 6796 graphics (CG) models to create driving scenarios. However, creating CG models Err codemadness.org 70 i 6797 and vehicle movements (e.g., the assets for simulation) remains a manual task Err codemadness.org 70 i 6798 that can be costly and time-consuming. In addition, the fidelity of CG images Err codemadness.org 70 i 6799 still lacks the richness and authenticity of real-world images and using these Err codemadness.org 70 i 6800 images for training leads to degraded performance. Err codemadness.org 70 i 6801

Err codemadness.org 70 i 6802

In this paper we present a novel approach to address these issues: Augmented Err codemadness.org 70 i 6803 Autonomous Driving Simulation (AADS). Our formulation augments real-world Err codemadness.org 70 i 6804 pictures with a simulated traffic flow to create photo-realistic simulation Err codemadness.org 70 i 6805 images and renderings. More specifically, we use LiDAR and cameras to scan Err codemadness.org 70 i 6806 street scenes. From the acquired trajectory data, we generate highly plausible Err codemadness.org 70 i 6807 traffic flows for cars and pedestrians and compose them into the background. Err codemadness.org 70 i 6808 The composite images can be re-synthesized with different viewpoints and sensor Err codemadness.org 70 i 6809 models. The resulting images are photo-realistic, fully annotated, and ready Err codemadness.org 70 i 6810 for end-to-end training and testing of autonomous driving systems from Err codemadness.org 70 i 6811 perception to planning. We explain our system design and validate our Err codemadness.org 70 i 6812 algorithms with a number of autonomous driving tasks from detection to Err codemadness.org 70 i 6813 segmentation and predictions. Err codemadness.org 70 i 6814

Err codemadness.org 70 i 6815

Compared to traditional approaches, our method offers unmatched scalability Err codemadness.org 70 i 6816 and realism. Scalability is particularly important for AD simulation and we Err codemadness.org 70 i 6817 believe the complexity and diversity of the real world cannot be realistically Err codemadness.org 70 i 6818 captured in a virtual environment. Our augmented approach combines the Err codemadness.org 70 i 6819 flexibility in a virtual environment (e.g., vehicle movements) with the Err codemadness.org 70 i 6820 richness of the real world to allow effective simulation of anywhere on earth. Err codemadness.org 70 i 6821

Err codemadness.org 70 i 6822

Mockingbird: Defending Against Deep-Learning-Based Website Fingerprinting Attacks with Adversarial Traces. (arXiv:1902.06626v5 [cs.CR] UPDATED)

Website Fingerprinting (WF) is a type of traffic analysis attack that enables Err codemadness.org 70 i 6829 a local passive eavesdropper to infer the victim's activity, even when the Err codemadness.org 70 i 6830 traffic is protected by a VPN or an anonymity system like Tor. Leveraging a Err codemadness.org 70 i 6831 deep-learning classifier, a WF attacker can gain over 98% accuracy on Tor Err codemadness.org 70 i 6832 traffic. In this paper, we explore a novel defense, Mockingbird, based on the Err codemadness.org 70 i 6833 idea of adversarial examples that have been shown to undermine machine-learning Err codemadness.org 70 i 6834 classifiers in other domains. Since the attacker gets to design and train his Err codemadness.org 70 i 6835 attack classifier based on the defense, we first demonstrate that at a Err codemadness.org 70 i 6836 straightforward technique for generating adversarial-example based traces fails Err codemadness.org 70 i 6837 to protect against an attacker using adversarial training for robust Err codemadness.org 70 i 6838 classification. We then propose Mockingbird, a technique for generating traces Err codemadness.org 70 i 6839 that resists adversarial training by moving randomly in the space of viable Err codemadness.org 70 i 6840 traces and not following more predictable gradients. The technique drops the Err codemadness.org 70 i 6841 accuracy of the state-of-the-art attack hardened with adversarial training from Err codemadness.org 70 i 6842 98% to 42-58% while incurring only 58% bandwidth overhead. The attack accuracy Err codemadness.org 70 i 6843 is generally lower than state-of-the-art defenses, and much lower when Err codemadness.org 70 i 6844 considering Top-2 accuracy, while incurring lower bandwidth overheads. Err codemadness.org 70 i 6845

Err codemadness.org 70 i 6846

Global Optimality Guarantees For Policy Gradient Methods. (arXiv:1906.01786v2 [cs.LG] UPDATED)

Policy gradients methods apply to complex, poorly understood, control Err codemadness.org 70 i 6853 problems by performing stochastic gradient descent over a parameterized class Err codemadness.org 70 i 6854 of polices. Unfortunately, even for simple control problems solvable by Err codemadness.org 70 i 6855 standard dynamic programming techniques, policy gradient algorithms face Err codemadness.org 70 i 6856 non-convex optimization problems and are widely understood to converge only to Err codemadness.org 70 i 6857 a stationary point. This work identifies structural properties -- shared by Err codemadness.org 70 i 6858 several classic control problems -- that ensure the policy gradient objective Err codemadness.org 70 i 6859 function has no suboptimal stationary points despite being non-convex. When Err codemadness.org 70 i 6860 these conditions are strengthened, this objective satisfies a Err codemadness.org 70 i 6861 Polyak-lojasiewicz (gradient dominance) condition that yields convergence Err codemadness.org 70 i 6862 rates. We also provide bounds on the optimality gap of any stationary point Err codemadness.org 70 i 6863 when some of these conditions are relaxed. Err codemadness.org 70 i 6864

Err codemadness.org 70 i 6865

ATRW: A Benchmark for Amur Tiger Re-identification in the Wild. (arXiv:1906.05586v4 [cs.CV] UPDATED)

Monitoring the population and movements of endangered species is an important Err codemadness.org 70 i 6872 task to wildlife conversation. Traditional tagging methods do not scale to Err codemadness.org 70 i 6873 large populations, while applying computer vision methods to camera sensor data Err codemadness.org 70 i 6874 requires re-identification (re-ID) algorithms to obtain accurate counts and Err codemadness.org 70 i 6875 moving trajectory of wildlife. However, existing re-ID methods are largely Err codemadness.org 70 i 6876 targeted at persons and cars, which have limited pose variations and Err codemadness.org 70 i 6877 constrained capture environments. This paper tries to fill the gap by Err codemadness.org 70 i 6878 introducing a novel large-scale dataset, the Amur Tiger Re-identification in Err codemadness.org 70 i 6879 the Wild (ATRW) dataset. ATRW contains over 8,000 video clips from 92 Amur Err codemadness.org 70 i 6880 tigers, with bounding box, pose keypoint, and tiger identity annotations. In Err codemadness.org 70 i 6881 contrast to typical re-ID datasets, the tigers are captured in a diverse set of Err codemadness.org 70 i 6882 unconstrained poses and lighting conditions. We demonstrate with a set of Err codemadness.org 70 i 6883 baseline algorithms that ATRW is a challenging dataset for re-ID. Lastly, we Err codemadness.org 70 i 6884 propose a novel method for tiger re-identification, which introduces precise Err codemadness.org 70 i 6885 pose parts modeling in deep neural networks to handle large pose variation of Err codemadness.org 70 i 6886 tigers, and reaches notable performance improvement over existing re-ID Err codemadness.org 70 i 6887 methods. The dataset is public available at https://cvwc2019.github.io/ . Err codemadness.org 70 i 6888

Err codemadness.org 70 i 6889

A Simple Local Minimal Intensity Prior and An Improved Algorithm for Blind Image Deblurring. (arXiv:1906.06642v5 [eess.IV] UPDATED)

Blind image deblurring is a long standing challenging problem in image Err codemadness.org 70 i 6896 processing and low-level vision. Recently, sophisticated priors such as dark Err codemadness.org 70 i 6897 channel prior, extreme channel prior, and local maximum gradient prior, have Err codemadness.org 70 i 6898 shown promising effectiveness. However, these methods are computationally Err codemadness.org 70 i 6899 expensive. Meanwhile, since these priors involved subproblems cannot be solved Err codemadness.org 70 i 6900 explicitly, approximate solution is commonly used, which limits the best Err codemadness.org 70 i 6901 exploitation of their capability. To address these problems, this work firstly Err codemadness.org 70 i 6902 proposes a simplified sparsity prior of local minimal pixels, namely patch-wise Err codemadness.org 70 i 6903 minimal pixels (PMP). The PMP of clear images is much more sparse than that of Err codemadness.org 70 i 6904 blurred ones, and hence is very effective in discriminating between clear and Err codemadness.org 70 i 6905 blurred images. Then, a novel algorithm is designed to efficiently exploit the Err codemadness.org 70 i 6906 sparsity of PMP in deblurring. The new algorithm flexibly imposes sparsity Err codemadness.org 70 i 6907 inducing on the PMP under the MAP framework rather than directly uses the half Err codemadness.org 70 i 6908 quadratic splitting algorithm. By this, it avoids non-rigorous approximation Err codemadness.org 70 i 6909 solution in existing algorithms, while being much more computationally Err codemadness.org 70 i 6910 efficient. Extensive experiments demonstrate that the proposed algorithm can Err codemadness.org 70 i 6911 achieve better practical stability compared with state-of-the-arts. In terms of Err codemadness.org 70 i 6912 deblurring quality, robustness and computational efficiency, the new algorithm Err codemadness.org 70 i 6913 is superior to state-of-the-arts. Code for reproducing the results of the new Err codemadness.org 70 i 6914 method is available at https://github.com/FWen/deblur-pmp.git. Err codemadness.org 70 i 6915

Err codemadness.org 70 i 6916

Multi-type Resource Allocation with Partial Preferences. (arXiv:1906.06836v3 [cs.AI] UPDATED)

We propose multi-type probabilistic serial (MPS) and multi-type random Err codemadness.org 70 i 6923 priority (MRP) as extensions of the well known PS and RP mechanisms to the Err codemadness.org 70 i 6924 multi-type resource allocation problem (MTRA) with partial preferences. In our Err codemadness.org 70 i 6925 setting, there are multiple types of divisible items, and a group of agents who Err codemadness.org 70 i 6926 have partial order preferences over bundles consisting of one item of each Err codemadness.org 70 i 6927 type. We show that for the unrestricted domain of partial order preferences, no Err codemadness.org 70 i 6928 mechanism satisfies both sd-efficiency and sd-envy-freeness. Notwithstanding Err codemadness.org 70 i 6929 this impossibility result, our main message is positive: When agents' Err codemadness.org 70 i 6930 preferences are represented by acyclic CP-nets, MPS satisfies sd-efficiency, Err codemadness.org 70 i 6931 sd-envy-freeness, ordinal fairness, and upper invariance, while MRP satisfies Err codemadness.org 70 i 6932 ex-post-efficiency, sd-strategy-proofness, and upper invariance, recovering the Err codemadness.org 70 i 6933 properties of PS and RP. Err codemadness.org 70 i 6934

Err codemadness.org 70 i 6935

Dimensional Reweighting Graph Convolutional Networks. (arXiv:1907.02237v3 [cs.LG] UPDATED)

Graph Convolution Networks (GCNs) are becoming more and more popular for Err codemadness.org 70 i 6942 learning node representations on graphs. Though there exist various Err codemadness.org 70 i 6943 developments on sampling and aggregation to accelerate the training process and Err codemadness.org 70 i 6944 improve the performances, limited works focus on dealing with the dimensional Err codemadness.org 70 i 6945 information imbalance of node representations. To bridge the gap, we propose a Err codemadness.org 70 i 6946 method named Dimensional reweighting Graph Convolution Network (DrGCN). We Err codemadness.org 70 i 6947 theoretically prove that our DrGCN can guarantee to improve the stability of Err codemadness.org 70 i 6948 GCNs via mean field theory. Our dimensional reweighting method is very flexible Err codemadness.org 70 i 6949 and can be easily combined with most sampling and aggregation techniques for Err codemadness.org 70 i 6950 GCNs. Experimental results demonstrate its superior performances on several Err codemadness.org 70 i 6951 challenging transductive and inductive node classification benchmark datasets. Err codemadness.org 70 i 6952 Our DrGCN also outperforms existing models on an industrial-sized Alibaba Err codemadness.org 70 i 6953 recommendation dataset. Err codemadness.org 70 i 6954

Err codemadness.org 70 i 6955

Lexical Simplification with Pretrained Encoders. (arXiv:1907.06226v5 [cs.CL] UPDATED)

Lexical simplification (LS) aims to replace complex words in a given sentence Err codemadness.org 70 i 6962 with their simpler alternatives of equivalent meaning. Recently unsupervised Err codemadness.org 70 i 6963 lexical simplification approaches only rely on the complex word itself Err codemadness.org 70 i 6964 regardless of the given sentence to generate candidate substitutions, which Err codemadness.org 70 i 6965 will inevitably produce a large number of spurious candidates. We present a Err codemadness.org 70 i 6966 simple LS approach that makes use of the Bidirectional Encoder Representations Err codemadness.org 70 i 6967 from Transformers (BERT) which can consider both the given sentence and the Err codemadness.org 70 i 6968 complex word during generating candidate substitutions for the complex word. Err codemadness.org 70 i 6969 Specifically, we mask the complex word of the original sentence for feeding Err codemadness.org 70 i 6970 into the BERT to predict the masked token. The predicted results will be used Err codemadness.org 70 i 6971 as candidate substitutions. Despite being entirely unsupervised, experimental Err codemadness.org 70 i 6972 results show that our approach obtains obvious improvement compared with these Err codemadness.org 70 i 6973 baselines leveraging linguistic databases and parallel corpus, outperforming Err codemadness.org 70 i 6974 the state-of-the-art by more than 12 Accuracy points on three well-known Err codemadness.org 70 i 6975 benchmarks. Err codemadness.org 70 i 6976

Err codemadness.org 70 i 6977

Cover and variable degeneracy. (arXiv:1907.06630v3 [math.CO] UPDATED)

Let $f$ be a nonnegative integer valued function on the vertex set of a Err codemadness.org 70 i 6984 graph. A graph is {\bf strictly $f$-degenerate} if each nonempty subgraph Err codemadness.org 70 i 6985 $\Gamma$ has a vertex $v$ such that $\mathrm{deg}_{\Gamma}(v) < f(v)$. In this Err codemadness.org 70 i 6986 paper, we define a new concept, strictly $f$-degenerate transversal, which Err codemadness.org 70 i 6987 generalizes list coloring, signed coloring, DP-coloring, $L$-forested-coloring, Err codemadness.org 70 i 6988 and $(f_{1}, f_{2}, \dots, f_{s})$-partition. A {\bf cover} of a graph $G$ is a Err codemadness.org 70 i 6989 graph $H$ with vertex set $V(H) = \bigcup_{v \in V(G)} X_{v}$, where $X_{v} = Err codemadness.org 70 i 6990 \{(v, 1), (v, 2), \dots, (v, s)\}$; the edge set $\mathscr{M} = \bigcup_{uv \in Err codemadness.org 70 i 6991 E(G)}\mathscr{M}_{uv}$, where $\mathscr{M}_{uv}$ is a matching between $X_{u}$ Err codemadness.org 70 i 6992 and $X_{v}$. A vertex set $R \subseteq V(H)$ is a {\bf transversal} of $H$ if Err codemadness.org 70 i 6993 $|R \cap X_{v}| = 1$ for each $v \in V(G)$. A transversal $R$ is a {\bf Err codemadness.org 70 i 6994 strictly $f$-degenerate transversal} if $H[R]$ is strictly $f$-degenerate. The Err codemadness.org 70 i 6995 main result of this paper is a degree type result, which generalizes Brooks' Err codemadness.org 70 i 6996 theorem, Gallai's theorem, degree-choosable result, signed degree-colorable Err codemadness.org 70 i 6997 result, and DP-degree-colorable result. Similar to Borodin, Kostochka and Err codemadness.org 70 i 6998 Toft's variable degeneracy, this degree type result is also self-strengthening. Err codemadness.org 70 i 6999 We also give some structural results on critical graphs with respect to Err codemadness.org 70 i 7000 strictly $f$-degenerate transversal. Using these results, we can uniformly Err codemadness.org 70 i 7001 prove many new and known results. In the final section, we pose some open Err codemadness.org 70 i 7002 problems. Err codemadness.org 70 i 7003

Err codemadness.org 70 i 7004

An Iterative Vertex Enumeration Method for Objective Space Based Vector Optimization Algorithms. (arXiv:1907.08813v2 [math.OC] UPDATED)

An application area of vertex enumeration problem (VEP) is the usage within Err codemadness.org 70 i 7011 objective space based linear/convex {vector} optimization algorithms whose aim Err codemadness.org 70 i 7012 is to generate (an approximation of) the Pareto frontier. In such algorithms, Err codemadness.org 70 i 7013 VEP, which is defined in the objective space, is solved in each iteration and Err codemadness.org 70 i 7014 it has a special structure. Namely, the recession cone of the polyhedron to be Err codemadness.org 70 i 7015 generated is the {ordering} cone. We {consider and give a detailed description Err codemadness.org 70 i 7016 of} a vertex enumeration procedure, which iterates by calling a modified Err codemadness.org 70 i 7017 `double description (DD) method' that works for such unbounded polyhedrons. We Err codemadness.org 70 i 7018 employ this procedure as a function of an existing objective space based Err codemadness.org 70 i 7019 {vector} optimization algorithm (Algorithm 1); and test the performance of it Err codemadness.org 70 i 7020 for randomly generated linear multiobjective optimization problems. We compare Err codemadness.org 70 i 7021 the efficiency of this procedure with another existing DD method as well as Err codemadness.org 70 i 7022 with the current vertex enumeration subroutine of Algorithm 1. We observe that Err codemadness.org 70 i 7023 the modified procedure excels the others especially as the dimension of the Err codemadness.org 70 i 7024 vertex enumeration problem (the number of objectives of the corresponding Err codemadness.org 70 i 7025 multiobjective problem) increases. Err codemadness.org 70 i 7026

Err codemadness.org 70 i 7027

Developing an Unsupervised Real-time Anomaly Detection Scheme for Time Series with Multi-seasonality. (arXiv:1908.01146v2 [cs.LG] UPDATED)

On-line detection of anomalies in time series is a key technique used in Err codemadness.org 70 i 7034 various event-sensitive scenarios such as robotic system monitoring, smart Err codemadness.org 70 i 7035 sensor networks and data center security. However, the increasing diversity of Err codemadness.org 70 i 7036 data sources and the variety of demands make this task more challenging than Err codemadness.org 70 i 7037 ever. Firstly, the rapid increase in unlabeled data means supervised learning Err codemadness.org 70 i 7038 is becoming less suitable in many cases. Secondly, a large portion of time Err codemadness.org 70 i 7039 series data have complex seasonality features. Thirdly, on-line anomaly Err codemadness.org 70 i 7040 detection needs to be fast and reliable. In light of this, we have developed a Err codemadness.org 70 i 7041 prediction-driven, unsupervised anomaly detection scheme, which adopts a Err codemadness.org 70 i 7042 backbone model combining the decomposition and the inference of time series Err codemadness.org 70 i 7043 data. Further, we propose a novel metric, Local Trend Inconsistency (LTI), and Err codemadness.org 70 i 7044 an efficient detection algorithm that computes LTI in a real-time manner and Err codemadness.org 70 i 7045 scores each data point robustly in terms of its probability of being anomalous. Err codemadness.org 70 i 7046 We have conducted extensive experimentation to evaluate our algorithm with Err codemadness.org 70 i 7047 several datasets from both public repositories and production environments. The Err codemadness.org 70 i 7048 experimental results show that our scheme outperforms existing representative Err codemadness.org 70 i 7049 anomaly detection algorithms in terms of the commonly used metric, Area Under Err codemadness.org 70 i 7050 Curve (AUC), while achieving the desired efficiency. Err codemadness.org 70 i 7051

Err codemadness.org 70 i 7052

Cluster-based Distributed Augmented Lagrangian Algorithm for a Class of Constrained Convex Optimization Problems. (arXiv:1908.06634v3 [cs.MA] UPDATED)

We propose a distributed solution for a constrained convex optimization Err codemadness.org 70 i 7059 problem over a network of clustered agents each consisted of a set of Err codemadness.org 70 i 7060 subagents. The communication range of the clustered agents is such that they Err codemadness.org 70 i 7061 can form a connected undirected graph topology. The total cost in this Err codemadness.org 70 i 7062 optimization problem is the sum of the local convex costs of the subagents of Err codemadness.org 70 i 7063 each cluster. We seek a minimizer of this cost subject to a set of affine Err codemadness.org 70 i 7064 equality constraints, and a set of affine inequality constraints specifying the Err codemadness.org 70 i 7065 bounds on the decision variables if such bounds exist. We design our Err codemadness.org 70 i 7066 distributed algorithm in a cluster-based framework which results in a Err codemadness.org 70 i 7067 significant reduction in communication and computation costs. Our proposed Err codemadness.org 70 i 7068 distributed solution is a novel continuous-time algorithm that is linked to the Err codemadness.org 70 i 7069 augmented Lagrangian approach. It converges asymptotically when the local cost Err codemadness.org 70 i 7070 functions are convex and exponentially when they are strongly convex and have Err codemadness.org 70 i 7071 Lipschitz gradients. Moreover, we use an $\epsilon$-exact penalty function to Err codemadness.org 70 i 7072 address the inequality constraints and derive an explicit lower bound on the Err codemadness.org 70 i 7073 penalty function weight to guarantee convergence to $\epsilon$-neighborhood of Err codemadness.org 70 i 7074 the global minimum value of the cost. A numerical example demonstrates our Err codemadness.org 70 i 7075 results. Err codemadness.org 70 i 7076

Err codemadness.org 70 i 7077

Optimal Machine Intelligence at the Edge of Chaos. (arXiv:1909.05176v2 [cs.LG] UPDATED)

It has long been suggested that the biological brain operates at some Err codemadness.org 70 i 7084 critical point between two different phases, possibly order and chaos. Despite Err codemadness.org 70 i 7085 many indirect empirical evidence from the brain and analytical indication on Err codemadness.org 70 i 7086 simple neural networks, the foundation of this hypothesis on generic non-linear Err codemadness.org 70 i 7087 systems remains unclear. Here we develop a general theory that reveals the Err codemadness.org 70 i 7088 exact edge of chaos is the boundary between the chaotic phase and the Err codemadness.org 70 i 7089 (pseudo)periodic phase arising from Neimark-Sacker bifurcation. This edge is Err codemadness.org 70 i 7090 analytically determined by the asymptotic Jacobian norm values of the Err codemadness.org 70 i 7091 non-linear operator and influenced by the dimensionality of the system. The Err codemadness.org 70 i 7092 optimality at the edge of chaos is associated with the highest information Err codemadness.org 70 i 7093 transfer between input and output at this point similar to that of the logistic Err codemadness.org 70 i 7094 map. As empirical validations, our experiments on the various deep learning Err codemadness.org 70 i 7095 models in computer vision demonstrate the optimality of the models near the Err codemadness.org 70 i 7096 edge of chaos, and we observe that the state-of-art training algorithms push Err codemadness.org 70 i 7097 the models towards such edge as they become more accurate. We further Err codemadness.org 70 i 7098 establishes the theoretical understanding of deep learning model generalization Err codemadness.org 70 i 7099 through asymptotic stability. Err codemadness.org 70 i 7100

Err codemadness.org 70 i 7101

Inverse Kinematics for Serial Kinematic Chains via Sum of Squares Optimization. (arXiv:1909.09318v3 [cs.RO] UPDATED)

Inverse kinematics is a fundamental problem for articulated robots: fast and Err codemadness.org 70 i 7108 accurate algorithms are needed for translating task-related workspace Err codemadness.org 70 i 7109 constraints and goals into feasible joint configurations. In general, inverse Err codemadness.org 70 i 7110 kinematics for serial kinematic chains is a difficult nonlinear problem, for Err codemadness.org 70 i 7111 which closed form solutions cannot be easily obtained. Therefore, Err codemadness.org 70 i 7112 computationally efficient numerical methods that can be adapted to a general Err codemadness.org 70 i 7113 class of manipulators are of great importance. % to motion planning and Err codemadness.org 70 i 7114 workspace generation tasks. In this paper, we use convex optimization Err codemadness.org 70 i 7115 techniques to solve the inverse kinematics problem with joint limit constraints Err codemadness.org 70 i 7116 for highly redundant serial kinematic chains with spherical joints in two and Err codemadness.org 70 i 7117 three dimensions. This is accomplished through a novel formulation of inverse Err codemadness.org 70 i 7118 kinematics as a nearest point problem, and with a fast sum of squares solver Err codemadness.org 70 i 7119 that exploits the sparsity of kinematic constraints for serial manipulators. Err codemadness.org 70 i 7120 Our method has the advantages of post-hoc certification of global optimality Err codemadness.org 70 i 7121 and a runtime that scales polynomialy with the number of degrees of freedom. Err codemadness.org 70 i 7122 Additionally, we prove that our convex relaxation leads to a globally optimal Err codemadness.org 70 i 7123 solution when certain conditions are met, and demonstrate empirically that Err codemadness.org 70 i 7124 these conditions are common and represent many practical instances. Finally, we Err codemadness.org 70 i 7125 provide an open source implementation of our algorithm. Err codemadness.org 70 i 7126

Err codemadness.org 70 i 7127

Noisy Batch Active Learning with Deterministic Annealing. (arXiv:1909.12473v2 [cs.LG] UPDATED)

We study the problem of training machine learning models incrementally with Err codemadness.org 70 i 7134 batches of samples annotated with noisy oracles. We select each batch of Err codemadness.org 70 i 7135 samples that are important and also diverse via clustering and importance Err codemadness.org 70 i 7136 sampling. More importantly, we incorporate model uncertainty into the sampling Err codemadness.org 70 i 7137 probability to compensate for poor estimation of the importance scores when the Err codemadness.org 70 i 7138 training data is too small to build a meaningful model. Experiments on Err codemadness.org 70 i 7139 benchmark image classification datasets (MNIST, SVHN, CIFAR10, and EMNIST) show Err codemadness.org 70 i 7140 improvement over existing active learning strategies. We introduce an extra Err codemadness.org 70 i 7141 denoising layer to deep networks to make active learning robust to label noises Err codemadness.org 70 i 7142 and show significant improvements. Err codemadness.org 70 i 7143

Err codemadness.org 70 i 7144

Subspace Estimation from Unbalanced and Incomplete Data Matrices: $\ell_{2,\infty}$ Statistical Guarantees. (arXiv:1910.04267v4 [math.ST] UPDATED)

This paper is concerned with estimating the column space of an unknown Err codemadness.org 70 i 7151 low-rank matrix $\boldsymbol{A}^{\star}\in\mathbb{R}^{d_{1}\times d_{2}}$, Err codemadness.org 70 i 7152 given noisy and partial observations of its entries. There is no shortage of Err codemadness.org 70 i 7153 scenarios where the observations -- while being too noisy to support faithful Err codemadness.org 70 i 7154 recovery of the entire matrix -- still convey sufficient information to enable Err codemadness.org 70 i 7155 reliable estimation of the column space of interest. This is particularly Err codemadness.org 70 i 7156 evident and crucial for the highly unbalanced case where the column dimension Err codemadness.org 70 i 7157 $d_{2}$ far exceeds the row dimension $d_{1}$, which is the focal point of the Err codemadness.org 70 i 7158 current paper. We investigate an efficient spectral method, which operates upon Err codemadness.org 70 i 7159 the sample Gram matrix with diagonal deletion. While this algorithmic idea has Err codemadness.org 70 i 7160 been studied before, we establish new statistical guarantees for this method in Err codemadness.org 70 i 7161 terms of both $\ell_{2}$ and $\ell_{2,\infty}$ estimation accuracy, which Err codemadness.org 70 i 7162 improve upon prior results if $d_{2}$ is substantially larger than $d_{1}$. To Err codemadness.org 70 i 7163 illustrate the effectiveness of our findings, we derive matching minimax lower Err codemadness.org 70 i 7164 bounds with respect to the noise levels, and develop consequences of our Err codemadness.org 70 i 7165 general theory for three applications of practical importance: (1) tensor Err codemadness.org 70 i 7166 completion from noisy data, (2) covariance estimation / principal component Err codemadness.org 70 i 7167 analysis with missing data, and (3) community recovery in bipartite graphs. Our Err codemadness.org 70 i 7168 theory leads to improved performance guarantees for all three cases. Err codemadness.org 70 i 7169

Err codemadness.org 70 i 7170

ProxIQA: A Proxy Approach to Perceptual Optimization of Learned Image Compression. (arXiv:1910.08845v2 [eess.IV] UPDATED)

The use of $\ell_p$ $(p=1,2)$ norms has largely dominated the measurement of Err codemadness.org 70 i 7177 loss in neural networks due to their simplicity and analytical properties. Err codemadness.org 70 i 7178 However, when used to assess the loss of visual information, these simple norms Err codemadness.org 70 i 7179 are not very consistent with human perception. Here, we describe a different Err codemadness.org 70 i 7180 "proximal" approach to optimize image analysis networks against quantitative Err codemadness.org 70 i 7181 perceptual models. Specifically, we construct a proxy network, broadly termed Err codemadness.org 70 i 7182 ProxIQA, which mimics the perceptual model while serving as a loss layer of the Err codemadness.org 70 i 7183 network. We experimentally demonstrate how this optimization framework can be Err codemadness.org 70 i 7184 applied to train an end-to-end optimized image compression network. By building Err codemadness.org 70 i 7185 on top of an existing deep image compression model, we are able to demonstrate Err codemadness.org 70 i 7186 a bitrate reduction of as much as $31\%$ over MSE optimization, given a Err codemadness.org 70 i 7187 specified perceptual quality (VMAF) level. Err codemadness.org 70 i 7188

Err codemadness.org 70 i 7189

Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation. (arXiv:1910.13067v4 [cs.LG] UPDATED)

There is an increasing interest in a fast-growing machine learning technique Err codemadness.org 70 i 7196 called Federated Learning, in which the model training is distributed over Err codemadness.org 70 i 7197 mobile user equipments (UEs), exploiting UEs' local computation and training Err codemadness.org 70 i 7198 data. Despite its advantages in data privacy-preserving, Federated Learning Err codemadness.org 70 i 7199 (FL) still has challenges in heterogeneity across UEs' data and physical Err codemadness.org 70 i 7200 resources. We first propose a FL algorithm which can handle the heterogeneous Err codemadness.org 70 i 7201 UEs' data challenge without further assumptions except strongly convex and Err codemadness.org 70 i 7202 smooth loss functions. We provide the convergence rate characterizing the Err codemadness.org 70 i 7203 trade-off between local computation rounds of UE to update its local model and Err codemadness.org 70 i 7204 global communication rounds to update the FL global model. We then employ the Err codemadness.org 70 i 7205 proposed FL algorithm in wireless networks as a resource allocation Err codemadness.org 70 i 7206 optimization problem that captures the trade-off between the FL convergence Err codemadness.org 70 i 7207 wall clock time and energy consumption of UEs with heterogeneous computing and Err codemadness.org 70 i 7208 power resources. Even though the wireless resource allocation problem of FL is Err codemadness.org 70 i 7209 non-convex, we exploit this problem's structure to decompose it into three Err codemadness.org 70 i 7210 sub-problems and analyze their closed-form solutions as well as insights to Err codemadness.org 70 i 7211 problem design. Finally, we illustrate the theoretical analysis for the new Err codemadness.org 70 i 7212 algorithm with Tensorflow experiments and extensive numerical results for the Err codemadness.org 70 i 7213 wireless resource allocation sub-problems. The experiment results not only Err codemadness.org 70 i 7214 verify the theoretical convergence but also show that our proposed algorithm Err codemadness.org 70 i 7215 outperforms the vanilla FedAvg algorithm in terms of convergence rate and Err codemadness.org 70 i 7216 testing accuracy. Err codemadness.org 70 i 7217

Err codemadness.org 70 i 7218

Making the Best Use of Review Summary for Sentiment Analysis. (arXiv:1911.02711v2 [cs.CL] UPDATED)

Sentiment analysis provides a useful overview of customer review contents. Err codemadness.org 70 i 7225 Many review websites allow a user to enter a summary in addition to a full Err codemadness.org 70 i 7226 review. Intuitively, summary information may give additional benefit for review Err codemadness.org 70 i 7227 sentiment analysis. In this paper, we conduct a study to exploit methods for Err codemadness.org 70 i 7228 better use of summary information. We start by finding out that the sentimental Err codemadness.org 70 i 7229 signal distribution of a review and that of its corresponding summary are in Err codemadness.org 70 i 7230 fact complementary to each other. We thus explore various architectures to Err codemadness.org 70 i 7231 better guide the interactions between the two and propose a Err codemadness.org 70 i 7232 hierarchically-refined review-centric attention model. Empirical results show Err codemadness.org 70 i 7233 that our review-centric model can make better use of user-written summaries for Err codemadness.org 70 i 7234 review sentiment analysis, and is also more effective compared to existing Err codemadness.org 70 i 7235 methods when the user summary is replaced with summary generated by an Err codemadness.org 70 i 7236 automatic summarization system. Err codemadness.org 70 i 7237

Err codemadness.org 70 i 7238

Minimalistic Attacks: How Little it Takes to Fool a Deep Reinforcement Learning Policy. (arXiv:1911.03849v5 [cs.LG] UPDATED)

Recent studies have revealed that neural network-based policies can be easily Err codemadness.org 70 i 7245 fooled by adversarial examples. However, while most prior works analyze the Err codemadness.org 70 i 7246 effects of perturbing every pixel of every frame assuming white-box policy Err codemadness.org 70 i 7247 access, in this paper we take a more restrictive view towards adversary Err codemadness.org 70 i 7248 generation - with the goal of unveiling the limits of a model's vulnerability. Err codemadness.org 70 i 7249 In particular, we explore minimalistic attacks by defining three key settings: Err codemadness.org 70 i 7250 (1) black-box policy access: where the attacker only has access to the input Err codemadness.org 70 i 7251 (state) and output (action probability) of an RL policy; (2) fractional-state Err codemadness.org 70 i 7252 adversary: where only several pixels are perturbed, with the extreme case being Err codemadness.org 70 i 7253 a single-pixel adversary; and (3) tactically-chanced attack: where only Err codemadness.org 70 i 7254 significant frames are tactically chosen to be attacked. We formulate the Err codemadness.org 70 i 7255 adversarial attack by accommodating the three key settings and explore their Err codemadness.org 70 i 7256 potency on six Atari games by examining four fully trained state-of-the-art Err codemadness.org 70 i 7257 policies. In Breakout, for example, we surprisingly find that: (i) all policies Err codemadness.org 70 i 7258 showcase significant performance degradation by merely modifying 0.01% of the Err codemadness.org 70 i 7259 input state, and (ii) the policy trained by DQN is totally deceived by Err codemadness.org 70 i 7260 perturbation to only 1% frames. Err codemadness.org 70 i 7261

Err codemadness.org 70 i 7262

Rethinking Self-Attention: Towards Interpretability in Neural Parsing. (arXiv:1911.03875v3 [cs.CL] UPDATED)

Attention mechanisms have improved the performance of NLP tasks while Err codemadness.org 70 i 7269 allowing models to remain explainable. Self-attention is currently widely used, Err codemadness.org 70 i 7270 however interpretability is difficult due to the numerous attention Err codemadness.org 70 i 7271 distributions. Recent work has shown that model representations can benefit Err codemadness.org 70 i 7272 from label-specific information, while facilitating interpretation of Err codemadness.org 70 i 7273 predictions. We introduce the Label Attention Layer: a new form of Err codemadness.org 70 i 7274 self-attention where attention heads represent labels. We test our novel layer Err codemadness.org 70 i 7275 by running constituency and dependency parsing experiments and show our new Err codemadness.org 70 i 7276 model obtains new state-of-the-art results for both tasks on both the Penn Err codemadness.org 70 i 7277 Treebank (PTB) and Chinese Treebank. Additionally, our model requires fewer Err codemadness.org 70 i 7278 self-attention layers compared to existing work. Finally, we find that the Err codemadness.org 70 i 7279 Label Attention heads learn relations between syntactic categories and show Err codemadness.org 70 i 7280 pathways to analyze errors. Err codemadness.org 70 i 7281

Err codemadness.org 70 i 7282

Privacy-Preserving Gradient Boosting Decision Trees. (arXiv:1911.04209v3 [cs.LG] UPDATED)

The Gradient Boosting Decision Tree (GBDT) is a popular machine learning Err codemadness.org 70 i 7289 model for various tasks in recent years. In this paper, we study how to improve Err codemadness.org 70 i 7290 model accuracy of GBDT while preserving the strong guarantee of differential Err codemadness.org 70 i 7291 privacy. Sensitivity and privacy budget are two key design aspects for the Err codemadness.org 70 i 7292 effectiveness of differential private models. Existing solutions for GBDT with Err codemadness.org 70 i 7293 differential privacy suffer from the significant accuracy loss due to too loose Err codemadness.org 70 i 7294 sensitivity bounds and ineffective privacy budget allocations (especially Err codemadness.org 70 i 7295 across different trees in the GBDT model). Loose sensitivity bounds lead to Err codemadness.org 70 i 7296 more noise to obtain a fixed privacy level. Ineffective privacy budget Err codemadness.org 70 i 7297 allocations worsen the accuracy loss especially when the number of trees is Err codemadness.org 70 i 7298 large. Therefore, we propose a new GBDT training algorithm that achieves Err codemadness.org 70 i 7299 tighter sensitivity bounds and more effective noise allocations. Specifically, Err codemadness.org 70 i 7300 by investigating the property of gradient and the contribution of each tree in Err codemadness.org 70 i 7301 GBDTs, we propose to adaptively control the gradients of training data for each Err codemadness.org 70 i 7302 iteration and leaf node clipping in order to tighten the sensitivity bounds. Err codemadness.org 70 i 7303 Furthermore, we design a novel boosting framework to allocate the privacy Err codemadness.org 70 i 7304 budget between trees so that the accuracy loss can be further reduced. Our Err codemadness.org 70 i 7305 experiments show that our approach can achieve much better model accuracy than Err codemadness.org 70 i 7306 other baselines. Err codemadness.org 70 i 7307

Err codemadness.org 70 i 7308

A Continuous Teleoperation Subspace with Empirical and Algorithmic Mapping Algorithms for Non-Anthropomorphic Hands. (arXiv:1911.09565v5 [cs.RO] UPDATED)

Teleoperation is a valuable tool for robotic manipulators in highly Err codemadness.org 70 i 7315 unstructured environments. However, finding an intuitive mapping between a Err codemadness.org 70 i 7316 human hand and a non-anthropomorphic robot hand can be difficult, due to the Err codemadness.org 70 i 7317 hands' dissimilar kinematics. In this paper, we seek to create a mapping Err codemadness.org 70 i 7318 between the human hand and a fully actuated, non-anthropomorphic robot hand Err codemadness.org 70 i 7319 that is intuitive enough to enable effective real-time teleoperation, even for Err codemadness.org 70 i 7320 novice users. To accomplish this, we propose a low-dimensional teleoperation Err codemadness.org 70 i 7321 subspace which can be used as an intermediary for mapping between hand pose Err codemadness.org 70 i 7322 spaces. We present two different methods to define the teleoperation subspace: Err codemadness.org 70 i 7323 an empirical definition, which requires a person to define hand motions in an Err codemadness.org 70 i 7324 intuitive, hand-specific way, and an algorithmic definition, which is Err codemadness.org 70 i 7325 kinematically independent, and uses objects to define the subspace. We use each Err codemadness.org 70 i 7326 of these definitions to create a teleoperation mapping for different hands. One Err codemadness.org 70 i 7327 of the main contributions of this paper is the validation of both the empirical Err codemadness.org 70 i 7328 and algorithmic mappings with teleoperation experiments controlled by ten Err codemadness.org 70 i 7329 novices and performed on two kinematically distinct hands. The experiments show Err codemadness.org 70 i 7330 that the proposed subspace is relevant to teleoperation, intuitive enough to Err codemadness.org 70 i 7331 enable control by novices, and can generalize to non-anthropomorphic hands with Err codemadness.org 70 i 7332 different kinematics. Err codemadness.org 70 i 7333

Err codemadness.org 70 i 7334

QoS-Aware Joint Power Allocation and Task Offloading in a MEC/NFV-enabled C-RAN Network. (arXiv:1912.00187v2 [cs.NI] UPDATED)

In this paper, we propose a novel resource management scheme that jointly Err codemadness.org 70 i 7341 allocates the transmission power and computational resources in a centralized Err codemadness.org 70 i 7342 radio access network architecture. The network comprises a set of computing Err codemadness.org 70 i 7343 nodes to which the requested tasks of different users are offloaded. The Err codemadness.org 70 i 7344 optimization problem takes the transmission, execution, and propagation delays Err codemadness.org 70 i 7345 of each task into account, with the aim to allocate the transmission power and Err codemadness.org 70 i 7346 computational resources such that the user's maximum tolerable latency is Err codemadness.org 70 i 7347 satisfied. Since the optimization problem is highly non-convex, we adopt the Err codemadness.org 70 i 7348 alternate search method (ASM) to divide it into smaller subproblems. A Err codemadness.org 70 i 7349 heuristic algorithm is proposed to jointly manage the allocated computational Err codemadness.org 70 i 7350 resources and placement of the tasks derived by ASM. We also propose an Err codemadness.org 70 i 7351 admission control mechanism for finding the set of tasks that can be served by Err codemadness.org 70 i 7352 the available resources. Furthermore, a disjoint method that separately Err codemadness.org 70 i 7353 allocates the transmission power and the computational resources is proposed as Err codemadness.org 70 i 7354 the baseline of comparison. The optimal solution of the optimization problem is Err codemadness.org 70 i 7355 also derived based on exhaustive search over offloading decisions and utilizing Err codemadness.org 70 i 7356 Karush-Kuhn-Tucker optimality conditions. The simulation results show that the Err codemadness.org 70 i 7357 joint method outperforms the disjoint task offloading and power allocation. Err codemadness.org 70 i 7358 Moreover, simulations show that the performance of the proposed method is Err codemadness.org 70 i 7359 almost equal to that of the optimal solution. Err codemadness.org 70 i 7360

Err codemadness.org 70 i 7361

Hierarchical Indian Buffet Neural Networks for Bayesian Continual Learning. (arXiv:1912.02290v4 [stat.ML] UPDATED)

We place an Indian Buffet process (IBP) prior over the structure of a Err codemadness.org 70 i 7368 Bayesian Neural Network (BNN), thus allowing the complexity of the BNN to Err codemadness.org 70 i 7369 increase and decrease automatically. We further extend this model such that the Err codemadness.org 70 i 7370 prior on the structure of each hidden layer is shared globally across all Err codemadness.org 70 i 7371 layers, using a Hierarchical-IBP (H-IBP). We apply this model to the problem of Err codemadness.org 70 i 7372 resource allocation in Continual Learning (CL) where new tasks occur and the Err codemadness.org 70 i 7373 network requires extra resources. Our model uses online variational inference Err codemadness.org 70 i 7374 with reparameterisation of the Bernoulli and Beta distributions, which Err codemadness.org 70 i 7375 constitute the IBP and H-IBP priors. As we automatically learn the number of Err codemadness.org 70 i 7376 weights in each layer of the BNN, overfitting and underfitting problems are Err codemadness.org 70 i 7377 largely overcome. We show empirically that our approach offers a competitive Err codemadness.org 70 i 7378 edge over existing methods in CL. Err codemadness.org 70 i 7379

Err codemadness.org 70 i 7380

CoSimLex: A Resource for Evaluating Graded Word Similarity in Context. (arXiv:1912.05320v3 [cs.CL] UPDATED)

State of the art natural language processing tools are built on Err codemadness.org 70 i 7387 context-dependent word embeddings, but no direct method for evaluating these Err codemadness.org 70 i 7388 representations currently exists. Standard tasks and datasets for intrinsic Err codemadness.org 70 i 7389 evaluation of embeddings are based on judgements of similarity, but ignore Err codemadness.org 70 i 7390 context; standard tasks for word sense disambiguation take account of context Err codemadness.org 70 i 7391 but do not provide continuous measures of meaning similarity. This paper Err codemadness.org 70 i 7392 describes an effort to build a new dataset, CoSimLex, intended to fill this Err codemadness.org 70 i 7393 gap. Building on the standard pairwise similarity task of SimLex-999, it Err codemadness.org 70 i 7394 provides context-dependent similarity measures; covers not only discrete Err codemadness.org 70 i 7395 differences in word sense but more subtle, graded changes in meaning; and Err codemadness.org 70 i 7396 covers not only a well-resourced language (English) but a number of Err codemadness.org 70 i 7397 less-resourced languages. We define the task and evaluation metrics, outline Err codemadness.org 70 i 7398 the dataset collection methodology, and describe the status of the dataset so Err codemadness.org 70 i 7399 far. Err codemadness.org 70 i 7400

Err codemadness.org 70 i 7401

What it Thinks is Important is Important: Robustness Transfers through Input Gradients. (arXiv:1912.05699v3 [cs.LG] UPDATED)

Adversarial perturbations are imperceptible changes to input pixels that can Err codemadness.org 70 i 7408 change the prediction of deep learning models. Learned weights of models robust Err codemadness.org 70 i 7409 to such perturbations are previously found to be transferable across different Err codemadness.org 70 i 7410 tasks but this applies only if the model architecture for the source and target Err codemadness.org 70 i 7411 tasks is the same. Input gradients characterize how small changes at each input Err codemadness.org 70 i 7412 pixel affect the model output. Using only natural images, we show here that Err codemadness.org 70 i 7413 training a student model's input gradients to match those of a robust teacher Err codemadness.org 70 i 7414 model can gain robustness close to a strong baseline that is robustly trained Err codemadness.org 70 i 7415 from scratch. Through experiments in MNIST, CIFAR-10, CIFAR-100 and Err codemadness.org 70 i 7416 Tiny-ImageNet, we show that our proposed method, input gradient adversarial Err codemadness.org 70 i 7417 matching, can transfer robustness across different tasks and even across Err codemadness.org 70 i 7418 different model architectures. This demonstrates that directly targeting the Err codemadness.org 70 i 7419 semantics of input gradients is a feasible way towards adversarial robustness. Err codemadness.org 70 i 7420

Err codemadness.org 70 i 7421

ORCA: a Benchmark for Data Web Crawlers. (arXiv:1912.08026v2 [cs.DB] UPDATED)

The number of RDF knowledge graphs available on the Web grows constantly. Err codemadness.org 70 i 7428 Gathering these graphs at large scale for downstream applications hence Err codemadness.org 70 i 7429 requires the use of crawlers. Although Data Web crawlers exist, and general Web Err codemadness.org 70 i 7430 crawlers could be adapted to focus on the Data Web, there is currently no Err codemadness.org 70 i 7431 benchmark to fairly evaluate their performance. Our work closes this gap by Err codemadness.org 70 i 7432 presenting the Orca benchmark. Orca generates a synthetic Data Web, which is Err codemadness.org 70 i 7433 decoupled from the original Web and enables a fair and repeatable comparison of Err codemadness.org 70 i 7434 Data Web crawlers. Our evaluations show that Orca can be used to reveal the Err codemadness.org 70 i 7435 different advantages and disadvantages of existing crawlers. The benchmark is Err codemadness.org 70 i 7436 open-source and available at https://github.com/dice-group/orca. Err codemadness.org 70 i 7437

Err codemadness.org 70 i 7438

Deep Automodulators. (arXiv:1912.10321v4 [cs.LG] UPDATED)

We introduce a new category of generative autoencoders called automodulators. Err codemadness.org 70 i 7445 These networks can faithfully reproduce individual real-world input images like Err codemadness.org 70 i 7446 regular autoencoders, but also generate a fused sample from an arbitrary Err codemadness.org 70 i 7447 combination of several such images, allowing instantaneous 'style-mixing' and Err codemadness.org 70 i 7448 other new applications. An automodulator decouples the data flow of decoder Err codemadness.org 70 i 7449 operations from statistical properties thereof and uses the latent vector to Err codemadness.org 70 i 7450 modulate the former by the latter, with a principled approach for mutual Err codemadness.org 70 i 7451 disentanglement of decoder layers. Prior work has explored similar decoder Err codemadness.org 70 i 7452 architecture with GANs, but their focus has been on random sampling. A Err codemadness.org 70 i 7453 corresponding autoencoder could operate on real input images. For the first Err codemadness.org 70 i 7454 time, we show how to train such a general-purpose model with sharp outputs in Err codemadness.org 70 i 7455 high resolution, using novel training techniques, demonstrated on four image Err codemadness.org 70 i 7456 data sets. Besides style-mixing, we show state-of-the-art results in Err codemadness.org 70 i 7457 autoencoder comparison, and visual image quality nearly indistinguishable from Err codemadness.org 70 i 7458 state-of-the-art GANs. We expect the automodulator variants to become a useful Err codemadness.org 70 i 7459 building block for image applications and other data domains. Err codemadness.org 70 i 7460

Err codemadness.org 70 i 7461

Statistical Limits of Supervised Quantum Learning. (arXiv:2001.10477v3 [quant-ph] UPDATED)

Within the framework of statistical learning theory it is possible to bound Err codemadness.org 70 i 7468 the minimum number of samples required by a learner to reach a target accuracy. Err codemadness.org 70 i 7469 We show that if the bound on the accuracy is taken into account, quantum Err codemadness.org 70 i 7470 machine learning algorithms for supervised learning---for which statistical Err codemadness.org 70 i 7471 guarantees are available---cannot achieve polylogarithmic runtimes in the input Err codemadness.org 70 i 7472 dimension. We conclude that, when no further assumptions on the problem are Err codemadness.org 70 i 7473 made, quantum machine learning algorithms for supervised learning can have at Err codemadness.org 70 i 7474 most polynomial speedups over efficient classical algorithms, even in cases Err codemadness.org 70 i 7475 where quantum access to the data is naturally available. Err codemadness.org 70 i 7476

Err codemadness.org 70 i 7477

Can Graph Neural Networks Count Substructures?. (arXiv:2002.04025v4 [cs.LG] UPDATED)

The ability to detect and count certain substructures in graphs is important Err codemadness.org 70 i 7484 for solving many tasks on graph-structured data, especially in the contexts of Err codemadness.org 70 i 7485 computational chemistry and biology as well as social network analysis. Err codemadness.org 70 i 7486 Inspired by this, we propose to study the expressive power of graph neural Err codemadness.org 70 i 7487 networks (GNNs) via their ability to count attributed graph substructures, Err codemadness.org 70 i 7488 extending recent works that examine their power in graph isomorphism testing Err codemadness.org 70 i 7489 and function approximation. We distinguish between two types of substructure Err codemadness.org 70 i 7490 counting: induced-subgraph-count and subgraph-count, and establish both Err codemadness.org 70 i 7491 positive and negative answers for popular GNN architectures. Specifically, we Err codemadness.org 70 i 7492 prove that Message Passing Neural Networks (MPNNs), 2-Weisfeiler-Lehman (2-WL) Err codemadness.org 70 i 7493 and 2-Invariant Graph Networks (2-IGNs) cannot perform induced-subgraph-count Err codemadness.org 70 i 7494 of substructures consisting of 3 or more nodes, while they can perform Err codemadness.org 70 i 7495 subgraph-count of star-shaped substructures. As an intermediary step, we prove Err codemadness.org 70 i 7496 that 2-WL and 2-IGNs are equivalent in distinguishing non-isomorphic graphs, Err codemadness.org 70 i 7497 partly answering an open problem raised in Maron et al. (2019). We also prove Err codemadness.org 70 i 7498 positive results for k-WL and k-IGNs as well as negative results for k-WL with Err codemadness.org 70 i 7499 a finite number of iterations. We then conduct experiments that support the Err codemadness.org 70 i 7500 theoretical results for MPNNs and 2-IGNs. Moreover, motivated by substructure Err codemadness.org 70 i 7501 counting and inspired by Murphy et al. (2019), we propose the Local Relational Err codemadness.org 70 i 7502 Pooling model and demonstrate that it is not only effective for substructure Err codemadness.org 70 i 7503 counting but also able to achieve competitive performance on molecular Err codemadness.org 70 i 7504 prediction tasks. Err codemadness.org 70 i 7505

Err codemadness.org 70 i 7506

An implicit function learning approach for parametric modal regression. (arXiv:2002.06195v2 [stat.ML] UPDATED)

For multi-valued functions---such as when the conditional distribution on Err codemadness.org 70 i 7513 targets given the inputs is multi-modal---standard regression approaches are Err codemadness.org 70 i 7514 not always desirable because they provide the conditional mean. Modal Err codemadness.org 70 i 7515 regression algorithms address this issue by instead finding the conditional Err codemadness.org 70 i 7516 mode(s). Most, however, are nonparametric approaches and so can be difficult to Err codemadness.org 70 i 7517 scale. Further, parametric approximators, like neural networks, facilitate Err codemadness.org 70 i 7518 learning complex relationships between inputs and targets. In this work, we Err codemadness.org 70 i 7519 propose a parametric modal regression algorithm. We use the implicit function Err codemadness.org 70 i 7520 theorem to develop an objective, for learning a joint function over inputs and Err codemadness.org 70 i 7521 targets. We empirically demonstrate on several synthetic problems that our Err codemadness.org 70 i 7522 method (i) can learn multi-valued functions and produce the conditional modes, Err codemadness.org 70 i 7523 (ii) scales well to high-dimensional inputs, and (iii) can even be more Err codemadness.org 70 i 7524 effective for certain uni-modal problems, particularly for high-frequency Err codemadness.org 70 i 7525 functions. We demonstrate that our method is competitive in a real-world modal Err codemadness.org 70 i 7526 regression problem and two regular regression datasets. Err codemadness.org 70 i 7527

Err codemadness.org 70 i 7528

Learning Global Transparent Models Consistent with Local Contrastive Explanations. (arXiv:2002.08247v4 [cs.LG] UPDATED)

There is a rich and growing literature on producing local Err codemadness.org 70 i 7535 contrastive/counterfactual explanations for black-box models (e.g. neural Err codemadness.org 70 i 7536 networks). Err codemadness.org 70 i 7537

Err codemadness.org 70 i 7538

In these methods, for an input, an explanation is in the form of a contrast Err codemadness.org 70 i 7539 point differing in very few features from the original input and lying in a Err codemadness.org 70 i 7540 different class. Other works try to build globally interpretable models like Err codemadness.org 70 i 7541 decision trees and rule lists based on the data using actual labels or based on Err codemadness.org 70 i 7542 the black-box models predictions. Although these interpretable global models Err codemadness.org 70 i 7543 can be useful, they may not be consistent with local explanations from a Err codemadness.org 70 i 7544 specific black-box of choice. In this work, we explore the question: Can we Err codemadness.org 70 i 7545 produce a transparent global model that is simultaneously accurate and Err codemadness.org 70 i 7546 consistent with the local (contrastive) explanations of the black-box model? We Err codemadness.org 70 i 7547 introduce a natural local consistency metric that quantifies if the local Err codemadness.org 70 i 7548 explanations and predictions of the black-box model are also consistent with Err codemadness.org 70 i 7549 the proxy global transparent model. Based on a key insight we propose a novel Err codemadness.org 70 i 7550 method where we create custom boolean features from sparse local contrastive Err codemadness.org 70 i 7551 explanations of the black-box model and then train a globally transparent model Err codemadness.org 70 i 7552 on just these, and showcase empirically that such models have higher local Err codemadness.org 70 i 7553 consistency compared with other known strategies, while still being close in Err codemadness.org 70 i 7554 performance to models that are trained with access to the original data. Err codemadness.org 70 i 7555

Err codemadness.org 70 i 7556

A two-stage data-analysis method for total-reflection high-energy positron diffraction (TRHEPD). (arXiv:2002.12165v2 [cond-mat.mtrl-sci] UPDATED)

Total-reflection high-energy positron diffraction (TRHEPD) is a novel Err codemadness.org 70 i 7563 experimental method for the determination of surface structure, which has been Err codemadness.org 70 i 7564 extensively developed at the Slow Positron Facility, Institute of Materials Err codemadness.org 70 i 7565 Structure Science, High Energy Accelerator Research Organization (KEK). In this Err codemadness.org 70 i 7566 paper, a two-stage data-analysis method is proposed. The data analysis is based Err codemadness.org 70 i 7567 on an inverse problem in which the atomic positions of a surface structure are Err codemadness.org 70 i 7568 determined from the experimental diffraction data (rocking curves). The Err codemadness.org 70 i 7569 relevant forward problem is solved by the numerical solution of the partial Err codemadness.org 70 i 7570 differential equation for quantum scattering of the positron. In the present Err codemadness.org 70 i 7571 two-stage method, the first stage is a grid-based global search and the second Err codemadness.org 70 i 7572 stage is a local search for the unique candidate for the atomic arrangement. Err codemadness.org 70 i 7573 The numerical problem is solved on a supercomputer Err codemadness.org 70 i 7574

Err codemadness.org 70 i 7575

Curriculum By Smoothing. (arXiv:2003.01367v3 [cs.LG] UPDATED)

Convolutional Neural Networks (CNNs) have shown impressive performance in Err codemadness.org 70 i 7582 computer vision tasks such as image classification, detection, and Err codemadness.org 70 i 7583 segmentation. Moreover, recent work in Generative Adversarial Networks (GANs) Err codemadness.org 70 i 7584 has highlighted the importance of learning by progressively increasing the Err codemadness.org 70 i 7585 difficulty of a learning task [26]. When learning a network from scratch, the Err codemadness.org 70 i 7586 information propagated within the network during the earlier stages of training Err codemadness.org 70 i 7587 can contain distortion artifacts due to noise which can be detrimental to Err codemadness.org 70 i 7588 training. In this paper, we propose an elegant curriculum based scheme that Err codemadness.org 70 i 7589 smoothes the feature embedding of a CNN using anti-aliasing or low-pass Err codemadness.org 70 i 7590 filters. We propose to augment the train-ing of CNNs by controlling the amount Err codemadness.org 70 i 7591 of high frequency information propagated within the CNNs as training Err codemadness.org 70 i 7592 progresses, by convolving the output of a CNN feature map of each layer with a Err codemadness.org 70 i 7593 Gaussian kernel. By decreasing the variance of the Gaussian kernel, we Err codemadness.org 70 i 7594 gradually increase the amount of high-frequency information available within Err codemadness.org 70 i 7595 the network for inference. As the amount of information in the feature maps Err codemadness.org 70 i 7596 increases during training, the network is able to progressively learn better Err codemadness.org 70 i 7597 representations of the data. Our proposed augmented training scheme Err codemadness.org 70 i 7598 significantly improves the performance of CNNs on various vision tasks without Err codemadness.org 70 i 7599 either adding additional trainable parameters or an auxiliary regularization Err codemadness.org 70 i 7600 objective. The generality of our method is demonstrated through empirical Err codemadness.org 70 i 7601 performance gains in CNN architectures across four different tasks: transfer Err codemadness.org 70 i 7602 learning, cross-task transfer learning, and generative models. Err codemadness.org 70 i 7603

Err codemadness.org 70 i 7604

Forgetting Outside the Box: Scrubbing Deep Networks of Information Accessible from Input-Output Observations. (arXiv:2003.02960v3 [cs.LG] UPDATED)

We describe a procedure for removing dependency on a cohort of training data Err codemadness.org 70 i 7611 from a trained deep network that improves upon and generalizes previous methods Err codemadness.org 70 i 7612 to different readout functions and can be extended to ensure forgetting in the Err codemadness.org 70 i 7613 activations of the network. We introduce a new bound on how much information Err codemadness.org 70 i 7614 can be extracted per query about the forgotten cohort from a black-box network Err codemadness.org 70 i 7615 for which only the input-output behavior is observed. The proposed forgetting Err codemadness.org 70 i 7616 procedure has a deterministic part derived from the differential equations of a Err codemadness.org 70 i 7617 linearized version of the model, and a stochastic part that ensures information Err codemadness.org 70 i 7618 destruction by adding noise tailored to the geometry of the loss landscape. We Err codemadness.org 70 i 7619 exploit the connections between the activation and weight dynamics of a DNN Err codemadness.org 70 i 7620 inspired by Neural Tangent Kernels to compute the information in the Err codemadness.org 70 i 7621 activations. Err codemadness.org 70 i 7622

Err codemadness.org 70 i 7623

No Surprises: Training Robust Lung Nodule Detection for Low-Dose CT Scans by Augmenting with Adversarial Attacks. (arXiv:2003.03824v2 [eess.IV] UPDATED)

Detecting malignant pulmonary nodules at an early stage can allow medical Err codemadness.org 70 i 7630 interventions which may increase the survival rate of lung cancer patients. Err codemadness.org 70 i 7631 Using computer vision techniques to detect nodules can improve the sensitivity Err codemadness.org 70 i 7632 and the speed of interpreting chest CT for lung cancer screening. Many studies Err codemadness.org 70 i 7633 have used CNNs to detect nodule candidates. Though such approaches have been Err codemadness.org 70 i 7634 shown to outperform the conventional image processing based methods regarding Err codemadness.org 70 i 7635 the detection accuracy, CNNs are also known to be limited to generalize on Err codemadness.org 70 i 7636 under-represented samples in the training set and prone to imperceptible noise Err codemadness.org 70 i 7637 perturbations. Such limitations can not be easily addressed by scaling up the Err codemadness.org 70 i 7638 dataset or the models. In this work, we propose to add adversarial synthetic Err codemadness.org 70 i 7639 nodules and adversarial attack samples to the training data to improve the Err codemadness.org 70 i 7640 generalization and the robustness of the lung nodule detection systems. To Err codemadness.org 70 i 7641 generate hard examples of nodules from a differentiable nodule synthesizer, we Err codemadness.org 70 i 7642 use projected gradient descent (PGD) to search the latent code within a bounded Err codemadness.org 70 i 7643 neighbourhood that would generate nodules to decrease the detector response. To Err codemadness.org 70 i 7644 make the network more robust to unanticipated noise perturbations, we use PGD Err codemadness.org 70 i 7645 to search for noise patterns that can trigger the network to give Err codemadness.org 70 i 7646 over-confident mistakes. By evaluating on two different benchmark datasets Err codemadness.org 70 i 7647 containing consensus annotations from three radiologists, we show that the Err codemadness.org 70 i 7648 proposed techniques can improve the detection performance on real CT data. To Err codemadness.org 70 i 7649 understand the limitations of both the conventional networks and the proposed Err codemadness.org 70 i 7650 augmented networks, we also perform stress-tests on the false positive Err codemadness.org 70 i 7651 reduction networks by feeding different types of artificially produced patches. Err codemadness.org 70 i 7652 We show that the augmented networks are more robust to both under-represented Err codemadness.org 70 i 7653 nodules as well as resistant to noise perturbations. Err codemadness.org 70 i 7654

Err codemadness.org 70 i 7655

Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule. (arXiv:2003.03977v4 [cs.LG] UPDATED)

Several papers argue that wide minima generalize better than narrow minima. Err codemadness.org 70 i 7662 In this paper, through detailed experiments that not only corroborate the Err codemadness.org 70 i 7663 generalization properties of wide minima, we also provide empirical evidence Err codemadness.org 70 i 7664 for a new hypothesis that the density of wide minima is likely lower than the Err codemadness.org 70 i 7665 density of narrow minima. Further, motivated by this hypothesis, we design a Err codemadness.org 70 i 7666 novel explore-exploit learning rate schedule. On a variety of image and natural Err codemadness.org 70 i 7667 language datasets, compared to their original hand-tuned learning rate Err codemadness.org 70 i 7668 baselines, we show that our explore-exploit schedule can result in either up to Err codemadness.org 70 i 7669 0.84% higher absolute accuracy using the original training budget or up to 57% Err codemadness.org 70 i 7670 reduced training time while achieving the original reported accuracy. For Err codemadness.org 70 i 7671 example, we achieve state-of-the-art (SOTA) accuracy for IWSLT'14 (DE-EN) and Err codemadness.org 70 i 7672 WMT'14 (DE-EN) datasets by just modifying the learning rate schedule of a high Err codemadness.org 70 i 7673 performing model. Err codemadness.org 70 i 7674

Err codemadness.org 70 i 7675

Compressive Isogeometric Analysis. (arXiv:2003.06475v2 [math.NA] UPDATED)

This work is motivated by the difficulty in assembling the Galerkin matrix Err codemadness.org 70 i 7682 when solving Partial Differential Equations (PDEs) with Isogeometric Analysis Err codemadness.org 70 i 7683 (IGA) using B-splines of moderate-to-high polynomial degree. To mitigate this Err codemadness.org 70 i 7684 problem, we propose a novel methodology named CossIGA (COmpreSSive IsoGeometric Err codemadness.org 70 i 7685 Analysis), which combines the IGA principle with CORSING, a recently introduced Err codemadness.org 70 i 7686 sparse recovery approach for PDEs based on compressive sensing. CossIGA Err codemadness.org 70 i 7687 assembles only a small portion of a suitable IGA Petrov-Galerkin discretization Err codemadness.org 70 i 7688 and is effective whenever the PDE solution is sufficiently sparse or Err codemadness.org 70 i 7689 compressible, i.e., when most of its coefficients are zero or negligible. The Err codemadness.org 70 i 7690 sparsity of the solution is promoted by employing a multilevel dictionary of Err codemadness.org 70 i 7691 B-splines as opposed to a basis. Thanks to sparsity and the fact that only a Err codemadness.org 70 i 7692 fraction of the full discretization matrix is assembled, the proposed technique Err codemadness.org 70 i 7693 has the potential to lead to significant computational savings. We show the Err codemadness.org 70 i 7694 effectiveness of CossIGA for the solution of the 2D and 3D Poisson equation Err codemadness.org 70 i 7695 over nontrivial geometries by means of an extensive numerical investigation. Err codemadness.org 70 i 7696

Err codemadness.org 70 i 7697

Thermodynamic Cost of Edge Detection in Artificial Neural Network(ANN)-Based Processors. (arXiv:2003.08196v2 [eess.IV] UPDATED)

Architecture-based heat dissipation analyses allow us to reveal fundamental Err codemadness.org 70 i 7704 sources of inefficiency in a given processor and thereby provide us with Err codemadness.org 70 i 7705 road-maps to design less dissipative computing schemes independent of Err codemadness.org 70 i 7706 technology-base used to implement them. In this work, we study Err codemadness.org 70 i 7707 architectural-level contributions to energy dissipation in an Artificial Neural Err codemadness.org 70 i 7708 Network (ANN)-based processor that is trained to perform edge-detection task. Err codemadness.org 70 i 7709 We compare the training and information processing cost of ANN to that of Err codemadness.org 70 i 7710 conventional architectures and algorithms using 64-pixel binary image. Our Err codemadness.org 70 i 7711 results reveal the inherent efficiency advantages of an ANN network trained for Err codemadness.org 70 i 7712 specific tasks over general-purpose processors based on von Neumann Err codemadness.org 70 i 7713 architecture. We also compare the proposed performance improvements to that of Err codemadness.org 70 i 7714 Cellular Array Processors (CAPs) and illustrate the reduction in dissipation Err codemadness.org 70 i 7715 for special purpose processors. Lastly, we calculate the change in dissipation Err codemadness.org 70 i 7716 as a result of input data structure and show the effect of randomness on Err codemadness.org 70 i 7717 energetic cost of information processing. The results we obtained provide a Err codemadness.org 70 i 7718 basis for comparison for task-based fundamental energy efficiency analyses for Err codemadness.org 70 i 7719 a range of processors and therefore contribute to the study of Err codemadness.org 70 i 7720 architecture-level descriptions of processors and thermodynamic cost Err codemadness.org 70 i 7721 calculations based on physics of computation. Err codemadness.org 70 i 7722

Err codemadness.org 70 i 7723

On Calibration of Mixup Training for Deep Neural Networks. (arXiv:2003.09946v3 [cs.LG] UPDATED)

Deep Neural Networks (DNN) represent the state of the art in many tasks. Err codemadness.org 70 i 7730 However, due to their overparameterization, their generalization capabilities Err codemadness.org 70 i 7731 are in doubt and still a field under study. Consequently, DNN can overfit and Err codemadness.org 70 i 7732 assign overconfident predictions -- effects that have been shown to affect the Err codemadness.org 70 i 7733 calibration of the confidences assigned to unseen data. Data Augmentation (DA) Err codemadness.org 70 i 7734 strategies have been proposed to regularize these models, being Mixup one of Err codemadness.org 70 i 7735 the most popular due to its ability to improve the accuracy, the uncertainty Err codemadness.org 70 i 7736 quantification and the calibration of DNN. In this work however we argue and Err codemadness.org 70 i 7737 provide empirical evidence that, due to its fundamentals, Mixup does not Err codemadness.org 70 i 7738 necessarily improve calibration. Based on our observations we propose a new Err codemadness.org 70 i 7739 loss function that improves the calibration, and also sometimes the accuracy, Err codemadness.org 70 i 7740 of DNN trained with this DA technique. Our loss is inspired by Bayes decision Err codemadness.org 70 i 7741 theory and introduces a new training framework for designing losses for Err codemadness.org 70 i 7742 probabilistic modelling. We provide state-of-the-art accuracy with consistent Err codemadness.org 70 i 7743 improvements in calibration performance. Appendix and code are provided here: Err codemadness.org 70 i 7744 https://github.com/jmaronas/calibration_MixupDNN_ARCLoss.pytorch.git Err codemadness.org 70 i 7745

Err codemadness.org 70 i 7746

Unique Chinese Linguistic Phenomena. (arXiv:2004.00499v3 [cs.CL] UPDATED)

Linguistics holds unique characteristics of generality, stability, and Err codemadness.org 70 i 7753 nationality, which will affect the formulation of extraction strategies and Err codemadness.org 70 i 7754 should be incorporated into the relation extraction. Chinese open relation Err codemadness.org 70 i 7755 extraction is not well-established, because of the complexity of Chinese Err codemadness.org 70 i 7756 linguistics makes it harder to operate, and the methods for English are not Err codemadness.org 70 i 7757 compatible with that for Chinese. The diversities between Chinese and English Err codemadness.org 70 i 7758 linguistics are mainly reflected in morphology and syntax. Err codemadness.org 70 i 7759

Err codemadness.org 70 i 7760

Is Graph Structure Necessary for Multi-hop Question Answering?. (arXiv:2004.03096v2 [cs.CL] UPDATED)

Recently, attempting to model texts as graph structure and introducing graph Err codemadness.org 70 i 7767 neural networks to deal with it has become a trend in many NLP research areas. Err codemadness.org 70 i 7768 In this paper, we investigate whether the graph structure is necessary for Err codemadness.org 70 i 7769 multi-hop question answering. Our analysis is centered on HotpotQA. We Err codemadness.org 70 i 7770 construct a strong baseline model to establish that, with the proper use of Err codemadness.org 70 i 7771 pre-trained models, graph structure may not be necessary for multi-hop question Err codemadness.org 70 i 7772 answering. We point out that both graph structure and adjacency matrix are Err codemadness.org 70 i 7773 task-related prior knowledge, and graph-attention can be considered as a Err codemadness.org 70 i 7774 special case of self-attention. Experiments and visualized analysis demonstrate Err codemadness.org 70 i 7775 that graph-attention or the entire graph structure can be replaced by Err codemadness.org 70 i 7776 self-attention or Transformers. Err codemadness.org 70 i 7777

Err codemadness.org 70 i 7778

Risk-Constrained Linear-Quadratic Regulators. (arXiv:2004.04685v2 [eess.SY] UPDATED)

We propose a new risk-constrained reformulation of the standard Linear Err codemadness.org 70 i 7785 Quadratic Regulator (LQR) problem. Our framework is motivated by the fact that Err codemadness.org 70 i 7786 the classical (risk-neutral) LQR controller, although optimal in expectation, Err codemadness.org 70 i 7787 might be ineffective under relatively infrequent, yet statistically significant Err codemadness.org 70 i 7788 (risky) events. To effectively trade between average and extreme event Err codemadness.org 70 i 7789 performance, we introduce a new risk constraint, which explicitly restricts the Err codemadness.org 70 i 7790 total expected predictive variance of the state penalty by a user-prescribed Err codemadness.org 70 i 7791 level. We show that, under rather minimal conditions on the process noise Err codemadness.org 70 i 7792 (i.e., finite fourth-order moments), the optimal risk-aware controller can be Err codemadness.org 70 i 7793 evaluated explicitly and in closed form. In fact, it is affine relative to the Err codemadness.org 70 i 7794 state, and is always internally stable regardless of parameter tuning. Our new Err codemadness.org 70 i 7795 risk-aware controller: i) pushes the state away from directions where the noise Err codemadness.org 70 i 7796 exhibits heavy tails, by exploiting the third-order moment (skewness) of the Err codemadness.org 70 i 7797 noise; ii) inflates the state penalty in riskier directions, where both the Err codemadness.org 70 i 7798 noise covariance and the state penalty are simultaneously large. The properties Err codemadness.org 70 i 7799 of the proposed risk-aware LQR framework are also illustrated via indicative Err codemadness.org 70 i 7800 numerical examples. Err codemadness.org 70 i 7801

Err codemadness.org 70 i 7802

Supervised Contrastive Learning. (arXiv:2004.11362v2 [cs.LG] UPDATED)

Contrastive learning applied to self-supervised representation learning has Err codemadness.org 70 i 7809 seen a resurgence in recent years, leading to state of the art performance in Err codemadness.org 70 i 7810 the unsupervised training of deep image models. Modern batch contrastive Err codemadness.org 70 i 7811 approaches subsume or significantly outperform traditional contrastive losses Err codemadness.org 70 i 7812 such as triplet, max-margin and the N-pairs loss. In this work, we extend the Err codemadness.org 70 i 7813 self-supervised batch contrastive approach to the fully-supervised setting, Err codemadness.org 70 i 7814 allowing us to effectively leverage label information. Clusters of points Err codemadness.org 70 i 7815 belonging to the same class are pulled together in embedding space, while Err codemadness.org 70 i 7816 simultaneously pushing apart clusters of samples from different classes. We Err codemadness.org 70 i 7817 analyze two possible versions of the supervised contrastive (SupCon) loss, Err codemadness.org 70 i 7818 identifying the best-performing formulation of the loss. On ResNet-200, we Err codemadness.org 70 i 7819 achieve top-1 accuracy of 81.4% on the ImageNet dataset, which is 0.8% above Err codemadness.org 70 i 7820 the best number reported for this architecture. We show consistent Err codemadness.org 70 i 7821 outperformance over cross-entropy on other datasets and two ResNet variants. Err codemadness.org 70 i 7822 The loss shows benefits for robustness to natural corruptions and is more Err codemadness.org 70 i 7823 stable to hyperparameter settings such as optimizers and data augmentations. In Err codemadness.org 70 i 7824 reduced data settings, it outperforms cross-entropy significantly. Our loss Err codemadness.org 70 i 7825 function is simple to implement, and reference TensorFlow code is released at Err codemadness.org 70 i 7826 https://t.ly/supcon. Err codemadness.org 70 i 7827

Err codemadness.org 70 i 7828

An Epidemiological Modelling Approach for Covid19 via Data Assimilation. (arXiv:2004.12130v3 [stat.AP] UPDATED)

The global pandemic of the 2019-nCov requires the evaluation of policy Err codemadness.org 70 i 7835 interventions to mitigate future social and economic costs of quarantine Err codemadness.org 70 i 7836 measures worldwide. We propose an epidemiological model for forecasting and Err codemadness.org 70 i 7837 policy evaluation which incorporates new data in real-time through variational Err codemadness.org 70 i 7838 data assimilation. We analyze and discuss infection rates in China, the US and Err codemadness.org 70 i 7839 Italy. In particular, we develop a custom compartmental SIR model fit to Err codemadness.org 70 i 7840 variables related to the epidemic in Chinese cities, named SITR model. We Err codemadness.org 70 i 7841 compare and discuss model results which conducts updates as new observations Err codemadness.org 70 i 7842 become available. A hybrid data assimilation approach is applied to make Err codemadness.org 70 i 7843 results robust to initial conditions. We use the model to do inference on Err codemadness.org 70 i 7844 infection numbers as well as parameters such as the disease transmissibility Err codemadness.org 70 i 7845 rate or the rate of recovery. The parameterisation of the model is parsimonious Err codemadness.org 70 i 7846 and extendable, allowing for the incorporation of additional data and Err codemadness.org 70 i 7847 parameters of interest. This allows for scalability and the extension of the Err codemadness.org 70 i 7848 model to other locations or the adaption of novel data sources. Err codemadness.org 70 i 7849

Err codemadness.org 70 i 7850

Holistic Privacy for Electricity, Water, and Natural Gas Metering in Next Generation Smart Homes. (arXiv:2004.13363v3 [eess.SY] UPDATED)

In smart electricity grids, high time granularity (HTG) power consumption Err codemadness.org 70 i 7857 data can be decomposed into individual appliance load signatures via Err codemadness.org 70 i 7858 Nonintrusive Appliance Load Monitoring techniques to expose appliance usage Err codemadness.org 70 i 7859 profiles. Various methods ranging from load shaping to noise addition and data Err codemadness.org 70 i 7860 aggregation have been proposed to mitigate this problem. However, with the Err codemadness.org 70 i 7861 growing scarcity of natural resources, utilities other than electricity (such Err codemadness.org 70 i 7862 as water and natural gas) have also begun to be subject to HTG metering, which Err codemadness.org 70 i 7863 creates privacy issues similar to that of electricity. Therefore, employing Err codemadness.org 70 i 7864 privacy protection countermeasures for only electricity usage is ineffective Err codemadness.org 70 i 7865 for appliances that utilize additional/other metered resources. As such, Err codemadness.org 70 i 7866 existing privacy countermeasures and metrics need to be reevaluated to address Err codemadness.org 70 i 7867 not only electricity, but also any other resource that is metered. Furthermore, Err codemadness.org 70 i 7868 a holistic privacy protection approach for all metered resources must be Err codemadness.org 70 i 7869 adopted as the information leak from any of the resources has a potential to Err codemadness.org 70 i 7870 render the privacy preserving countermeasures for all the other resources Err codemadness.org 70 i 7871 futile. This paper introduces the privacy preservation problem for multiple HTG Err codemadness.org 70 i 7872 metered resources and explores potential solutions for its mitigation. Err codemadness.org 70 i 7873

Err codemadness.org 70 i 7874

Geometric group testing. (arXiv:2004.14632v3 [cs.CG] UPDATED)

Group testing is concerned with identifying $t$ defective items in a set of Err codemadness.org 70 i 7881 $m$ items, where each test reports whether a specific subset of items contains Err codemadness.org 70 i 7882 at least one defective. In non-adaptive group testing, the subsets to be tested Err codemadness.org 70 i 7883 are fixed in advance. By testing multiple items at once, the required number of Err codemadness.org 70 i 7884 tests can be made much smaller than $m$. In fact, for $t \in \mathcal{O}(1)$, Err codemadness.org 70 i 7885 the optimal number of (non-adaptive) tests is known to be $\Theta(\log{m})$. Err codemadness.org 70 i 7886

Err codemadness.org 70 i 7887

In this paper, we consider the problem of non-adaptive group testing in a Err codemadness.org 70 i 7888 geometric setting, where the items are points in $d$-dimensional Euclidean Err codemadness.org 70 i 7889 space and the tests are axis-parallel boxes (hyperrectangles). We present upper Err codemadness.org 70 i 7890 and lower bounds on the required number of tests under this geometric Err codemadness.org 70 i 7891 constraint. In contrast to the general, combinatorial case, the bounds in our Err codemadness.org 70 i 7892 geometric setting are polynomial in $m$. For instance, our results imply that Err codemadness.org 70 i 7893 identifying a defective pair in a set of $m$ points in the plane always Err codemadness.org 70 i 7894 requires $\Omega(m^{3/5})$ tests, and there exist configurations of $m$ points Err codemadness.org 70 i 7895 for which $\mathcal{O}(m^{2/3})$ tests are sufficient, whereas to identify a Err codemadness.org 70 i 7896 single defective point in the plane, $\Theta(m^{1/2})$ tests are always Err codemadness.org 70 i 7897 necessary and sometimes sufficient. Err codemadness.org 70 i 7898

Err codemadness.org 70 i 7899

Minimum Cuts in Geometric Intersection Graphs. (arXiv:2005.00858v2 [cs.CG] UPDATED)

Let $\mathcal{D}$ be a set of $n$ disks in the plane. The disk graph Err codemadness.org 70 i 7906 $G_\mathcal{D}$ for $\mathcal{D}$ is the undirected graph with vertex set Err codemadness.org 70 i 7907 $\mathcal{D}$ in which two disks are joined by an edge if and only if they Err codemadness.org 70 i 7908 intersect. The directed transmission graph $G^{\rightarrow}_\mathcal{D}$ for Err codemadness.org 70 i 7909 $\mathcal{D}$ is the directed graph with vertex set $\mathcal{D}$ in which Err codemadness.org 70 i 7910 there is an edge from a disk $D_1 \in \mathcal{D}$ to a disk $D_2 \in Err codemadness.org 70 i 7911 \mathcal{D}$ if and only if $D_1$ contains the center of $D_2$. Err codemadness.org 70 i 7912

Err codemadness.org 70 i 7913

Given $\mathcal{D}$ and two non-intersecting disks $s, t \in \mathcal{D}$, we Err codemadness.org 70 i 7914 show that a minimum $s$-$t$ vertex cut in $G_\mathcal{D}$ or in Err codemadness.org 70 i 7915 $G^{\rightarrow}_\mathcal{D}$ can be found in $O(n^{3/2}\text{polylog} n)$ Err codemadness.org 70 i 7916 expected time. To obtain our result, we combine an algorithm for the maximum Err codemadness.org 70 i 7917 flow problem in general graphs with dynamic geometric data structures to Err codemadness.org 70 i 7918 manipulate the disks. Err codemadness.org 70 i 7919

Err codemadness.org 70 i 7920

As an application, we consider the barrier resilience problem in a Err codemadness.org 70 i 7921 rectangular domain. In this problem, we have a vertical strip $S$ bounded by Err codemadness.org 70 i 7922 two vertical lines, $L_\ell$ and $L_r$, and a collection $\mathcal{D}$ of Err codemadness.org 70 i 7923 disks. Let $a$ be a point in $S$ above all disks of $\mathcal{D}$, and let $b$ Err codemadness.org 70 i 7924 a point in $S$ below all disks of $\mathcal{D}$. The task is to find a curve Err codemadness.org 70 i 7925 from $a$ to $b$ that lies in $S$ and that intersects as few disks of Err codemadness.org 70 i 7926 $\mathcal{D}$ as possible. Using our improved algorithm for minimum cuts in Err codemadness.org 70 i 7927 disk graphs, we can solve the barrier resilience problem in Err codemadness.org 70 i 7928 $O(n^{3/2}\text{polylog} n)$ expected time. Err codemadness.org 70 i 7929

Err codemadness.org 70 i 7930

Model Creation and Equivalence Proofs of Cellular Automata and Artificial Neural Networks. (arXiv:2005.01192v3 [cs.NE] UPDATED)

Computational methods and mathematical models have invaded arguably every Err codemadness.org 70 i 7937 scientific discipline forming its own field of research called computational Err codemadness.org 70 i 7938 science. Mathematical models are the theoretical foundation of computational Err codemadness.org 70 i 7939 science. Since Newton's time, differential equations in mathematical models Err codemadness.org 70 i 7940 have been widely and successfully used to describe the macroscopic or global Err codemadness.org 70 i 7941 behaviour of systems. With spatially inhomogeneous, time-varying, local Err codemadness.org 70 i 7942 element-specific, and often non-linear interactions, the dynamics of complex Err codemadness.org 70 i 7943 systems is in contrast more efficiently described by local rules and thus in an Err codemadness.org 70 i 7944 algorithmic and local or microscopic manner. The theory of mathematical Err codemadness.org 70 i 7945 modelling taking into account these characteristics of complex systems has to Err codemadness.org 70 i 7946 be established still. We recently presented a so-called allagmatic method Err codemadness.org 70 i 7947 including a system metamodel to provide a framework for describing, modelling, Err codemadness.org 70 i 7948 simulating, and interpreting complex systems. Implementations of cellular Err codemadness.org 70 i 7949 automata and artificial neural networks were described and created with that Err codemadness.org 70 i 7950 method. Guidance from philosophy were helpful in these first studies focusing Err codemadness.org 70 i 7951 on programming and feasibility. A rigorous mathematical formalism, however, is Err codemadness.org 70 i 7952 still missing. This would not only more precisely describe and define the Err codemadness.org 70 i 7953 system metamodel, it would also further generalise it and with that extend its Err codemadness.org 70 i 7954 reach to formal treatment in applied mathematics and theoretical aspects of Err codemadness.org 70 i 7955 computational science as well as extend its applicability to other mathematical Err codemadness.org 70 i 7956 and computational models such as agent-based models. Here, a mathematical Err codemadness.org 70 i 7957 definition of the system metamodel is provided. Based on the presented Err codemadness.org 70 i 7958 formalism, model creation and equivalence of cellular automata and artificial Err codemadness.org 70 i 7959 neural networks are proved. It thus provides a formal approach for studying the Err codemadness.org 70 i 7960 creation of mathematical models as well as their structural and operational Err codemadness.org 70 i 7961 comparison. Err codemadness.org 70 i 7962

Err codemadness.org 70 i 7963

Analysis of the Symmetric Join the Shortest Orbit Queue. (arXiv:2005.02683v2 [math.PR] UPDATED)

This work introduces the join the shortest queue policy in the retrial Err codemadness.org 70 i 7970 setting. We consider a Markovian single server retrial system with two infinite Err codemadness.org 70 i 7971 capacity orbits. An arriving job finding the server busy, it is forwarded to Err codemadness.org 70 i 7972 the least loaded orbit. Otherwise, it is forwarded to an orbit randomly. Err codemadness.org 70 i 7973 Orbiting jobs of either type retry to access the server independently. We Err codemadness.org 70 i 7974 investigate the stability condition, the stationary tail decay rate, and obtain Err codemadness.org 70 i 7975 the equilibrium distribution by using the compensation method. Err codemadness.org 70 i 7976

Err codemadness.org 70 i 7977

Anonymized GCN: A Novel Robust Graph Embedding Method via Hiding Node Position in Noise. (arXiv:2005.03482v2 [cs.LG] UPDATED)

Graph convolution network (GCN) have achieved state-of-the-art performance in Err codemadness.org 70 i 7984 the task of node prediction in the graph structure. However, with the gradual Err codemadness.org 70 i 7985 various of graph attack methods, there are lack of research on the robustness Err codemadness.org 70 i 7986 of GCN. In this paper, we prove the reason why GCN is vulnerable to attack: Err codemadness.org 70 i 7987 only training another GCN model can find the vulnerability of the target GCN Err codemadness.org 70 i 7988 model. To solve that, we propose a GCN model which is robust to attacks. By Err codemadness.org 70 i 7989 hiding the node's position in the Gaussian noise, the attacker will not be able Err codemadness.org 70 i 7990 to modify the connection information of the graph node, thus immune to the Err codemadness.org 70 i 7991 attack. Considering attackers usually modify the connection to interfere the Err codemadness.org 70 i 7992 prediction results of the target node, so, by hiding the connection of the Err codemadness.org 70 i 7993 graph in the noise through adversarial training, accurate node prediction can Err codemadness.org 70 i 7994 be completed only by the node number rather than its specific position in the Err codemadness.org 70 i 7995 graph, thus let the nodes in the graph are no longer related to the graph Err codemadness.org 70 i 7996 itself, that is to say, make the node anonymous. Specifically, we first Err codemadness.org 70 i 7997 demonstrated the key to determine the embedding of a specific node: the row Err codemadness.org 70 i 7998 corresponding to the node of the eigenmatrix of the Laplace matrix, by target Err codemadness.org 70 i 7999 it as the output of the generator, we take the corresponding noise as input. Err codemadness.org 70 i 8000 The generator will try to find the correct position of the node in the graph. Err codemadness.org 70 i 8001 Then the encoder and decoder are spliced both in discriminator, so that after Err codemadness.org 70 i 8002 adversarial training, the generator and discriminator can cooperate to complete Err codemadness.org 70 i 8003 the node prediction. Finally, All node positions can generated by noise at the Err codemadness.org 70 i 8004 same time, that is to say, the generator will hides all the connection Err codemadness.org 70 i 8005 information of the graph structure. The evaluation shows that we only need to Err codemadness.org 70 i 8006 obtain the initial features and node numbers of the nodes to complete the node Err codemadness.org 70 i 8007 prediction, and the accuracy did not decrease, but increased by 0.0293. Err codemadness.org 70 i 8008

Err codemadness.org 70 i 8009

InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs. (arXiv:2005.09635v2 [cs.CV] UPDATED)

Although Generative Adversarial Networks (GANs) have made significant Err codemadness.org 70 i 8016 progress in face synthesis, there lacks enough understanding of what GANs have Err codemadness.org 70 i 8017 learned in the latent representation to map a random code to a photo-realistic Err codemadness.org 70 i 8018 image. In this work, we propose a framework called InterFaceGAN to interpret Err codemadness.org 70 i 8019 the disentangled face representation learned by the state-of-the-art GAN models Err codemadness.org 70 i 8020 and study the properties of the facial semantics encoded in the latent space. Err codemadness.org 70 i 8021 We first find that GANs learn various semantics in some linear subspaces of the Err codemadness.org 70 i 8022 latent space. After identifying these subspaces, we can realistically Err codemadness.org 70 i 8023 manipulate the corresponding facial attributes without retraining the model. We Err codemadness.org 70 i 8024 then conduct a detailed study on the correlation between different semantics Err codemadness.org 70 i 8025 and manage to better disentangle them via subspace projection, resulting in Err codemadness.org 70 i 8026 more precise control of the attribute manipulation. Besides manipulating the Err codemadness.org 70 i 8027 gender, age, expression, and presence of eyeglasses, we can even alter the face Err codemadness.org 70 i 8028 pose and fix the artifacts accidentally made by GANs. Furthermore, we perform Err codemadness.org 70 i 8029 an in-depth face identity analysis and a layer-wise analysis to evaluate the Err codemadness.org 70 i 8030 editing results quantitatively. Finally, we apply our approach to real face Err codemadness.org 70 i 8031 editing by employing GAN inversion approaches and explicitly training Err codemadness.org 70 i 8032 feed-forward models based on the synthetic data established by InterFaceGAN. Err codemadness.org 70 i 8033 Extensive experimental results suggest that learning to synthesize faces Err codemadness.org 70 i 8034 spontaneously brings a disentangled and controllable face representation. Err codemadness.org 70 i 8035

Err codemadness.org 70 i 8036

Stochastic control liasons: Richard Sinkhorn meets Gaspard Monge on a Schroedinger bridge. (arXiv:2005.10963v2 [math.OC] UPDATED)

In 1931/32, Schroedinger studied a hot gas Gedankenexperiment, an instance of Err codemadness.org 70 i 8043 large deviations of the empirical distribution and an early example of the Err codemadness.org 70 i 8044 so-called maximum entropy inference method. This so-called Schroedinger bridge Err codemadness.org 70 i 8045 problem (SBP) was recently recognized as a regularization of the Err codemadness.org 70 i 8046 Monge-Kantorovich Optimal Mass Transport (OMT), leading to effective Err codemadness.org 70 i 8047 computation of the latter. Specifically, OMT with quadratic cost may be viewed Err codemadness.org 70 i 8048 as a zero-temperature limit of SBP, which amounts to minimization of the Err codemadness.org 70 i 8049 Helmholtz's free energy over probability distributions constrained to possess Err codemadness.org 70 i 8050 given marginals. The problem features a delicate compromise, mediated by a Err codemadness.org 70 i 8051 temperature parameter, between minimizing the internal energy and maximizing Err codemadness.org 70 i 8052 the entropy. These concepts are central to a rapidly expanding area of modern Err codemadness.org 70 i 8053 science dealing with the so-called {\em Sinkhorn algorithm} which appears as a Err codemadness.org 70 i 8054 special case of an algorithm first studied by the French analyst Robert Fortet Err codemadness.org 70 i 8055 in 1938/40 specifically for Schroedinger bridges. Due to the constraint on Err codemadness.org 70 i 8056 end-point distributions, dynamic programming is not a suitable tool to attack Err codemadness.org 70 i 8057 these problems. Instead, Fortet's iterative algorithm and its discrete Err codemadness.org 70 i 8058 counterpart, the Sinkhorn iteration, permit computation by iteratively solving Err codemadness.org 70 i 8059 the so-called {\em Schroedinger system}. In both the continuous as well as the Err codemadness.org 70 i 8060 discrete-time and space settings, {\em stochastic control} provides a Err codemadness.org 70 i 8061 reformulation and dynamic versions of these problems. The formalism behind Err codemadness.org 70 i 8062 these control problems have attracted attention as they lead to a variety of Err codemadness.org 70 i 8063 new applications in spacecraft guidance, control of robot or biological swarms, Err codemadness.org 70 i 8064 sensing, active cooling, network routing as well as in computer and data Err codemadness.org 70 i 8065 science. This multifacet and versatile framework, intertwining SBP and OMT, Err codemadness.org 70 i 8066 provides the substrate for a historical and technical overview of the field Err codemadness.org 70 i 8067 taken up in this paper. Err codemadness.org 70 i 8068

Err codemadness.org 70 i 8069

Multivariate Quasi-tight Framelets with High Balancing Orders Derived from Any Compactly Supported Refinable Vector Functions. (arXiv:2005.12451v2 [math.FA] UPDATED)

Generalizing wavelets by adding desired redundancy and flexibility,framelets Err codemadness.org 70 i 8076 are of interest and importance in many applications such as image processing Err codemadness.org 70 i 8077 and numerical algorithms. Several key properties of framelets are high Err codemadness.org 70 i 8078 vanishing moments for sparse multiscale representation, fast framelet Err codemadness.org 70 i 8079 transforms for numerical efficiency, and redundancy for robustness. However, it Err codemadness.org 70 i 8080 is a challenging problem to study and construct multivariate nonseparable Err codemadness.org 70 i 8081 framelets, mainly due to their intrinsic connections to factorization and Err codemadness.org 70 i 8082 syzygy modules of multivariate polynomial matrices. In this paper, we Err codemadness.org 70 i 8083 circumvent the above difficulties through the approach of quasi-tight Err codemadness.org 70 i 8084 framelets, which behave almost identically to tight framelets. Employing the Err codemadness.org 70 i 8085 popular oblique extension principle (OEP), from an arbitrary compactly Err codemadness.org 70 i 8086 supported $\dm$-refinable vector function $\phi$ with multiplicity greater than Err codemadness.org 70 i 8087 one, we prove that we can always derive from $\phi$ a compactly supported Err codemadness.org 70 i 8088 multivariate quasi-tight framelet such that (i) all the framelet generators Err codemadness.org 70 i 8089 have the highest possible order of vanishing moments;(ii) its associated fast Err codemadness.org 70 i 8090 framelet transform is compact with the highest balancing order.For a refinable Err codemadness.org 70 i 8091 scalar function $\phi$, the above item (ii) often cannot be achieved Err codemadness.org 70 i 8092 intrinsically but we show that we can always construct a compactly supported Err codemadness.org 70 i 8093 OEP-based multivariate quasi-tight framelet derived from $\phi$ satisfying item Err codemadness.org 70 i 8094 (i).This paper provides a comprehensive investigation on OEP-based multivariate Err codemadness.org 70 i 8095 quasi-tight multiframelets and their associated framelet transforms with high Err codemadness.org 70 i 8096 balancing orders. This deepens our theoretical understanding of multivariate Err codemadness.org 70 i 8097 quasi-tight multiframelets and their associated fast multiframelet transforms. Err codemadness.org 70 i 8098

Err codemadness.org 70 i 8099

Refining Implicit Argument Annotation for UCCA. (arXiv:2005.12889v2 [cs.CL] UPDATED)

Predicate-argument structure analysis is a central component in meaning Err codemadness.org 70 i 8106 representations of text. The fact that some arguments are not explicitly Err codemadness.org 70 i 8107 mentioned in a sentence gives rise to ambiguity in language understanding, and Err codemadness.org 70 i 8108 renders it difficult for machines to interpret text correctly. However, only Err codemadness.org 70 i 8109 few resources represent implicit roles for NLU, and existing studies in NLP Err codemadness.org 70 i 8110 only make coarse distinctions between categories of arguments omitted from Err codemadness.org 70 i 8111 linguistic form. This paper proposes a typology for fine-grained implicit Err codemadness.org 70 i 8112 argument annotation on top of Universal Conceptual Cognitive Annotation's Err codemadness.org 70 i 8113 foundational layer. The proposed implicit argument categorisation is driven by Err codemadness.org 70 i 8114 theories of implicit role interpretation and consists of six types: Deictic, Err codemadness.org 70 i 8115 Generic, Genre-based, Type-identifiable, Non-specific, and Iterated-set. We Err codemadness.org 70 i 8116 exemplify our design by revisiting part of the UCCA EWT corpus, providing a new Err codemadness.org 70 i 8117 dataset annotated with the refinement layer, and making a comparative analysis Err codemadness.org 70 i 8118 with other schemes. Err codemadness.org 70 i 8119

Err codemadness.org 70 i 8120

An Empirical Study of Bots in Software Development -- Characteristics and Challenges from a Practitioner's Perspective. (arXiv:2005.13969v2 [cs.SE] UPDATED)

Software engineering bots - automated tools that handle tedious tasks - are Err codemadness.org 70 i 8127 increasingly used by industrial and open source projects to improve developer Err codemadness.org 70 i 8128 productivity. Current research in this area is held back by a lack of consensus Err codemadness.org 70 i 8129 of what software engineering bots (DevBots) actually are, what characteristics Err codemadness.org 70 i 8130 distinguish them from other tools, and what benefits and challenges are Err codemadness.org 70 i 8131 associated with DevBot usage. In this paper we report on a mixed-method Err codemadness.org 70 i 8132 empirical study of DevBot usage in industrial practice. We report on findings Err codemadness.org 70 i 8133 from interviewing 21 and surveying a total of 111 developers. We identify three Err codemadness.org 70 i 8134 different personas among DevBot users (focusing on autonomy, chat interfaces, Err codemadness.org 70 i 8135 and "smartness"), each with different definitions of what a DevBot is, why Err codemadness.org 70 i 8136 developers use them, and what they struggle with. We conclude that future Err codemadness.org 70 i 8137 DevBot research should situate their work within our framework, to clearly Err codemadness.org 70 i 8138 identify what type of bot the work targets, and what advantages practitioners Err codemadness.org 70 i 8139 can expect. Further, we find that there currently is a lack of general purpose Err codemadness.org 70 i 8140 "smart" bots that go beyond simple automation tools or chat interfaces. This is Err codemadness.org 70 i 8141 problematic, as we have seen that such bots, if available, can have a Err codemadness.org 70 i 8142 transformative effect on the projects that use them. Err codemadness.org 70 i 8143

Err codemadness.org 70 i 8144

Sub-Band Knowledge Distillation Framework for Speech Enhancement. (arXiv:2005.14435v2 [eess.AS] UPDATED)

In single-channel speech enhancement, methods based on full-band spectral Err codemadness.org 70 i 8151 features have been widely studied. However, only a few methods pay attention to Err codemadness.org 70 i 8152 non-full-band spectral features. In this paper, we explore a knowledge Err codemadness.org 70 i 8153 distillation framework based on sub-band spectral mapping for single-channel Err codemadness.org 70 i 8154 speech enhancement. Specifically, we divide the full frequency band into Err codemadness.org 70 i 8155 multiple sub-bands and pre-train an elite-level sub-band enhancement model Err codemadness.org 70 i 8156 (teacher model) for each sub-band. These teacher models are dedicated to Err codemadness.org 70 i 8157 processing their own sub-bands. Next, under the teacher models' guidance, we Err codemadness.org 70 i 8158 train a general sub-band enhancement model (student model) that works for all Err codemadness.org 70 i 8159 sub-bands. Without increasing the number of model parameters and computational Err codemadness.org 70 i 8160 complexity, the student model's performance is further improved. To evaluate Err codemadness.org 70 i 8161 our proposed method, we conducted a large number of experiments on an Err codemadness.org 70 i 8162 open-source data set. The final experimental results show that the guidance Err codemadness.org 70 i 8163 from the elite-level teacher models dramatically improves the student model's Err codemadness.org 70 i 8164 performance, which exceeds the full-band model by employing fewer parameters. Err codemadness.org 70 i 8165

Err codemadness.org 70 i 8166

SNR-Based Teachers-Student Technique for Speech Enhancement. (arXiv:2005.14441v2 [eess.AS] UPDATED)

It is very challenging for speech enhancement methods to achieves robust Err codemadness.org 70 i 8173 performance under both high signal-to-noise ratio (SNR) and low SNR Err codemadness.org 70 i 8174 simultaneously. In this paper, we propose a method that integrates an SNR-based Err codemadness.org 70 i 8175 teachers-student technique and time-domain U-Net to deal with this problem. Err codemadness.org 70 i 8176 Specifically, this method consists of multiple teacher models and a student Err codemadness.org 70 i 8177 model. We first train the teacher models under multiple small-range SNRs that Err codemadness.org 70 i 8178 do not coincide with each other so that they can perform speech enhancement Err codemadness.org 70 i 8179 well within the specific SNR range. Then, we choose different teacher models to Err codemadness.org 70 i 8180 supervise the training of the student model according to the SNR of the Err codemadness.org 70 i 8181 training data. Eventually, the student model can perform speech enhancement Err codemadness.org 70 i 8182 under both high SNR and low SNR. To evaluate the proposed method, we Err codemadness.org 70 i 8183 constructed a dataset with an SNR ranging from -20dB to 20dB based on the Err codemadness.org 70 i 8184 public dataset. We experimentally analyzed the effectiveness of the SNR-based Err codemadness.org 70 i 8185 teachers-student technique and compared the proposed method with several Err codemadness.org 70 i 8186 state-of-the-art methods. Err codemadness.org 70 i 8187

Err codemadness.org 70 i 8188

A mathematical model for automatic differentiation in machine learning. (arXiv:2006.02080v2 [cs.LG] UPDATED)

Automatic differentiation, as implemented today, does not have a simple Err codemadness.org 70 i 8195 mathematical model adapted to the needs of modern machine learning. In this Err codemadness.org 70 i 8196 work we articulate the relationships between differentiation of programs as Err codemadness.org 70 i 8197 implemented in practice and differentiation of nonsmooth functions. To this end Err codemadness.org 70 i 8198 we provide a simple class of functions, a nonsmooth calculus, and show how they Err codemadness.org 70 i 8199 apply to stochastic approximation methods. We also evidence the issue of Err codemadness.org 70 i 8200 artificial critical points created by algorithmic differentiation and show how Err codemadness.org 70 i 8201 usual methods avoid these points with probability one. Err codemadness.org 70 i 8202

Err codemadness.org 70 i 8203

Convolutional Neural Networks for Global Human Settlements Mapping from Sentinel-2 Satellite Imagery. (arXiv:2006.03267v2 [eess.IV] UPDATED)

Spatially consistent and up-to-date maps of human settlements are crucial for Err codemadness.org 70 i 8210 addressing policies related to urbanization and sustainability, especially in Err codemadness.org 70 i 8211 the era of an increasingly urbanized world.The availability of open and free Err codemadness.org 70 i 8212 Sentinel-2 data of the Copernicus Earth Observation program offers a new Err codemadness.org 70 i 8213 opportunity for wall-to-wall mapping of human settlements at a global Err codemadness.org 70 i 8214 scale.This paper presents a deep-learning-based framework for a fully automated Err codemadness.org 70 i 8215 extraction of built-up areas at a spatial resolution of 10 m from a global Err codemadness.org 70 i 8216 composite of Sentinel-2 imagery.A multi-neuro modeling methodology building on Err codemadness.org 70 i 8217 a simple Convolution Neural Networks architecture for pixel-wise image Err codemadness.org 70 i 8218 classification of built-up areas is developed.The core features of the proposed Err codemadness.org 70 i 8219 model are the image patch of size 5 x 5 pixels adequate for describing built-up Err codemadness.org 70 i 8220 areas from Sentinel-2 imagery and the lightweight topology with a total number Err codemadness.org 70 i 8221 of 1,448,578 trainable parameters and 4 2D convolutional layers and 2 flattened Err codemadness.org 70 i 8222 layers.The deployment of the model on the global Sentinel-2 image composite Err codemadness.org 70 i 8223 provides the most detailed and complete map reporting about built-up areas for Err codemadness.org 70 i 8224 reference year 2018. The validation of the results with an independent Err codemadness.org 70 i 8225 reference data-set of building footprints covering 277 sites across the world Err codemadness.org 70 i 8226 establishes the reliability of the built-up layer produced by the proposed Err codemadness.org 70 i 8227 framework and the model robustness. Err codemadness.org 70 i 8228

Err codemadness.org 70 i 8229

3D Self-Supervised Methods for Medical Imaging. (arXiv:2006.03829v2 [cs.CV] UPDATED)

Self-supervised learning methods have witnessed a recent surge of interest Err codemadness.org 70 i 8236 after proving successful in multiple application fields. In this work, we Err codemadness.org 70 i 8237 leverage these techniques, and we propose 3D versions for five different Err codemadness.org 70 i 8238 self-supervised methods, in the form of proxy tasks. Our methods facilitate Err codemadness.org 70 i 8239 neural network feature learning from unlabeled 3D images, aiming to reduce the Err codemadness.org 70 i 8240 required cost for expert annotation. The developed algorithms are 3D Err codemadness.org 70 i 8241 Contrastive Predictive Coding, 3D Rotation prediction, 3D Jigsaw puzzles, Err codemadness.org 70 i 8242 Relative 3D patch location, and 3D Exemplar networks. Our experiments show that Err codemadness.org 70 i 8243 pretraining models with our 3D tasks yields more powerful semantic Err codemadness.org 70 i 8244 representations, and enables solving downstream tasks more accurately and Err codemadness.org 70 i 8245 efficiently, compared to training the models from scratch and to pretraining Err codemadness.org 70 i 8246 them on 2D slices. We demonstrate the effectiveness of our methods on three Err codemadness.org 70 i 8247 downstream tasks from the medical imaging domain: i) Brain Tumor Segmentation Err codemadness.org 70 i 8248 from 3D MRI, ii) Pancreas Tumor Segmentation from 3D CT, and iii) Diabetic Err codemadness.org 70 i 8249 Retinopathy Detection from 2D Fundus images. In each task, we assess the gains Err codemadness.org 70 i 8250 in data-efficiency, performance, and speed of convergence. Interestingly, we Err codemadness.org 70 i 8251 also find gains when transferring the learned representations, by our methods, Err codemadness.org 70 i 8252 from a large unlabeled 3D corpus to a small downstream-specific dataset. We Err codemadness.org 70 i 8253 achieve results competitive to state-of-the-art solutions at a fraction of the Err codemadness.org 70 i 8254 computational expense. We publish our implementations for the developed Err codemadness.org 70 i 8255 algorithms (both 3D and 2D versions) as an open-source library, in an effort to Err codemadness.org 70 i 8256 allow other researchers to apply and extend our methods on their datasets. Err codemadness.org 70 i 8257

Err codemadness.org 70 i 8258

Truthful Data Acquisition via Peer Prediction. (arXiv:2006.03992v2 [cs.GT] UPDATED)

We consider the problem of purchasing data for machine learning or Err codemadness.org 70 i 8265 statistical estimation. The data analyst has a budget to purchase datasets from Err codemadness.org 70 i 8266 multiple data providers. She does not have any test data that can be used to Err codemadness.org 70 i 8267 evaluate the collected data and can assign payments to data providers solely Err codemadness.org 70 i 8268 based on the collected datasets. We consider the problem in the standard Err codemadness.org 70 i 8269 Bayesian paradigm and in two settings: (1) data are only collected once; (2) Err codemadness.org 70 i 8270 data are collected repeatedly and each day's data are drawn independently from Err codemadness.org 70 i 8271 the same distribution. For both settings, our mechanisms guarantee that Err codemadness.org 70 i 8272 truthfully reporting one's dataset is always an equilibrium by adopting Err codemadness.org 70 i 8273 techniques from peer prediction: pay each provider the mutual information Err codemadness.org 70 i 8274 between his reported data and other providers' reported data. Depending on the Err codemadness.org 70 i 8275 data distribution, the mechanisms can also discourage misreports that would Err codemadness.org 70 i 8276 lead to inaccurate predictions. Our mechanisms also guarantee individual Err codemadness.org 70 i 8277 rationality and budget feasibility for certain underlying distributions in the Err codemadness.org 70 i 8278 first setting and for all distributions in the second setting. Err codemadness.org 70 i 8279

Err codemadness.org 70 i 8280

Self-consumption for energy communities in Spain: a regional analysis under the new legal framework. (arXiv:2006.06459v3 [eess.SY] UPDATED)

European climate polices acknowledge the role that energy communities can Err codemadness.org 70 i 8287 play in the energy transition. Self-consumption installations shared among Err codemadness.org 70 i 8288 those living in the same building are a good example of such energy Err codemadness.org 70 i 8289 communities. In this work, we perform a regional analysis of optimal Err codemadness.org 70 i 8290 self-consumption installations under the new legal framework recently passed in Err codemadness.org 70 i 8291 Spain. Results show that the optimal sizing of the installation leads to Err codemadness.org 70 i 8292 economic savings for self-consumers in all the territory, for both options with Err codemadness.org 70 i 8293 and without remuneration for energy surplus. A sensitivity analysis on Err codemadness.org 70 i 8294 technology costs revealed that batteries still require noticeably cost Err codemadness.org 70 i 8295 reductions to be cost-effective in a behind the meter self-consumption Err codemadness.org 70 i 8296 environment. In addition, solar compensation mechanisms make batteries less Err codemadness.org 70 i 8297 attractive in a scenario of low PV costs, since feeding PV surplus into the Err codemadness.org 70 i 8298 grid, yet less efficient, becomes more cost-effective. An improvement for the Err codemadness.org 70 i 8299 current energy surplus remuneration policy was proposed and analysed. It Err codemadness.org 70 i 8300 consists in the inclusion of the economic value of the avoided power losses in Err codemadness.org 70 i 8301 the remuneration. Err codemadness.org 70 i 8302

Err codemadness.org 70 i 8303

Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction. (arXiv:2006.06648v3 [cs.LG] UPDATED)

Many practical graph problems, such as knowledge graph construction and Err codemadness.org 70 i 8310 drug-drug interaction prediction, require to handle multi-relational graphs. Err codemadness.org 70 i 8311 However, handling real-world multi-relational graphs with Graph Neural Networks Err codemadness.org 70 i 8312 (GNNs) is often challenging due to their evolving nature, as new entities Err codemadness.org 70 i 8313 (nodes) can emerge over time. Moreover, newly emerged entities often have few Err codemadness.org 70 i 8314 links, which makes the learning even more difficult. Motivated by this Err codemadness.org 70 i 8315 challenge, we introduce a realistic problem of few-shot out-of-graph link Err codemadness.org 70 i 8316 prediction, where we not only predict the links between the seen and unseen Err codemadness.org 70 i 8317 nodes as in a conventional out-of-knowledge link prediction task but also Err codemadness.org 70 i 8318 between the unseen nodes, with only few edges per node. We tackle this problem Err codemadness.org 70 i 8319 with a novel transductive meta-learning framework which we refer to as Graph Err codemadness.org 70 i 8320 Extrapolation Networks (GEN). GEN meta-learns both the node embedding network Err codemadness.org 70 i 8321 for inductive inference (seen-to-unseen) and the link prediction network for Err codemadness.org 70 i 8322 transductive inference (unseen-to-unseen). For transductive link prediction, we Err codemadness.org 70 i 8323 further propose a stochastic embedding layer to model uncertainty in the link Err codemadness.org 70 i 8324 prediction between unseen entities. We validate our model on multiple benchmark Err codemadness.org 70 i 8325 datasets for knowledge graph completion and drug-drug interaction prediction. Err codemadness.org 70 i 8326 The results show that our model significantly outperforms relevant baselines Err codemadness.org 70 i 8327 for out-of-graph link prediction tasks. Err codemadness.org 70 i 8328

Err codemadness.org 70 i 8329

Frontiers in Mortar Methods for Isogeometric Analysis. (arXiv:2006.06677v3 [cs.CE] UPDATED)

Complex geometries as common in industrial applications consist of multiple Err codemadness.org 70 i 8336 patches, if spline based parametrizations are used. The requirements for the Err codemadness.org 70 i 8337 generation of analysis-suitable models are increasing dramatically since Err codemadness.org 70 i 8338 isogeometric analysis is directly based on the spline parametrization and Err codemadness.org 70 i 8339 nowadays used for the calculation of higher-order partial differential Err codemadness.org 70 i 8340 equations. The computational, or more general, the engineering analysis Err codemadness.org 70 i 8341 necessitates suitable coupling techniques between the different patches. Mortar Err codemadness.org 70 i 8342 methods have been successfully applied for coupling of patches and for contact Err codemadness.org 70 i 8343 mechanics in recent years to resolve the arising issues within the interface. Err codemadness.org 70 i 8344 We present here current achievements in the design of mortar technologies in Err codemadness.org 70 i 8345 isogeometric analysis within the Priority Program SPP 1748, Reliable Simulation Err codemadness.org 70 i 8346 Techniques in Solid Mechanics. Development of Non-standard Discretisation Err codemadness.org 70 i 8347 Methods, Mechanical and Mathematical Analysis. Err codemadness.org 70 i 8348

Err codemadness.org 70 i 8349

Sparse and Continuous Attention Mechanisms. (arXiv:2006.07214v3 [cs.LG] UPDATED)

Exponential families are widely used in machine learning; they include many Err codemadness.org 70 i 8356 distributions in continuous and discrete domains (e.g., Gaussian, Dirichlet, Err codemadness.org 70 i 8357 Poisson, and categorical distributions via the softmax transformation). Err codemadness.org 70 i 8358 Distributions in each of these families have fixed support. In contrast, for Err codemadness.org 70 i 8359 finite domains, there has been recent work on sparse alternatives to softmax Err codemadness.org 70 i 8360 (e.g. sparsemax and alpha-entmax), which have varying support, being able to Err codemadness.org 70 i 8361 assign zero probability to irrelevant categories. This paper expands that work Err codemadness.org 70 i 8362 in two directions: first, we extend alpha-entmax to continuous domains, Err codemadness.org 70 i 8363 revealing a link with Tsallis statistics and deformed exponential families. Err codemadness.org 70 i 8364 Second, we introduce continuous-domain attention mechanisms, deriving efficient Err codemadness.org 70 i 8365 gradient backpropagation algorithms for alpha in {1,2}. Experiments on Err codemadness.org 70 i 8366 attention-based text classification, machine translation, and visual question Err codemadness.org 70 i 8367 answering illustrate the use of continuous attention in 1D and 2D, showing that Err codemadness.org 70 i 8368 it allows attending to time intervals and compact regions. Err codemadness.org 70 i 8369

Err codemadness.org 70 i 8370

Neural Estimators for Conditional Mutual Information Using Nearest Neighbors Sampling. (arXiv:2006.07225v2 [cs.IT] UPDATED)

The estimation of mutual information (MI) or conditional mutual information Err codemadness.org 70 i 8377 (CMI) from a set of samples is a long-standing problem. A recent line of work Err codemadness.org 70 i 8378 in this area has leveraged the approximation power of artificial neural Err codemadness.org 70 i 8379 networks and has shown improvements over conventional methods. One important Err codemadness.org 70 i 8380 challenge in this new approach is the need to obtain, given the original Err codemadness.org 70 i 8381 dataset, a different set where the samples are distributed according to a Err codemadness.org 70 i 8382 specific product density function. This is particularly challenging when Err codemadness.org 70 i 8383 estimating CMI. Err codemadness.org 70 i 8384

Err codemadness.org 70 i 8385

In this paper, we introduce a new technique, based on k nearest neighbors Err codemadness.org 70 i 8386 (k-NN), to perform the resampling and derive high-confidence concentration Err codemadness.org 70 i 8387 bounds for the sample average. Then the technique is employed to train a neural Err codemadness.org 70 i 8388 network classifier and the CMI is estimated accordingly. We propose three Err codemadness.org 70 i 8389 estimators using this technique and prove their consistency, make a comparison Err codemadness.org 70 i 8390 between them and similar approaches in the literature, and experimentally show Err codemadness.org 70 i 8391 improvements in estimating the CMI in terms of accuracy and variance of the Err codemadness.org 70 i 8392 estimators. Err codemadness.org 70 i 8393

Err codemadness.org 70 i 8394

Learning Latent Space Energy-Based Prior Model. (arXiv:2006.08205v2 [stat.ML] UPDATED)

We propose to learn energy-based model (EBM) in the latent space of a Err codemadness.org 70 i 8401 generator model, so that the EBM serves as a prior model that stands on the Err codemadness.org 70 i 8402 top-down network of the generator model. Both the latent space EBM and the Err codemadness.org 70 i 8403 top-down network can be learned jointly by maximum likelihood, which involves Err codemadness.org 70 i 8404 short-run MCMC sampling from both the prior and posterior distributions of the Err codemadness.org 70 i 8405 latent vector. Due to the low dimensionality of the latent space and the Err codemadness.org 70 i 8406 expressiveness of the top-down network, a simple EBM in latent space can Err codemadness.org 70 i 8407 capture regularities in the data effectively, and MCMC sampling in latent space Err codemadness.org 70 i 8408 is efficient and mixes well. We show that the learned model exhibits strong Err codemadness.org 70 i 8409 performances in terms of image and text generation and anomaly detection. The Err codemadness.org 70 i 8410 one-page code can be found in supplementary materials. Err codemadness.org 70 i 8411

Err codemadness.org 70 i 8412

Iterative regularization for convex regularizers. (arXiv:2006.09859v2 [stat.ML] UPDATED)

We study iterative regularization for linear models, when the bias is convex Err codemadness.org 70 i 8419 but not necessarily strongly convex. We characterize the stability properties Err codemadness.org 70 i 8420 of a primal-dual gradient based approach, analyzing its convergence in the Err codemadness.org 70 i 8421 presence of worst case deterministic noise. As a main example, we specialize Err codemadness.org 70 i 8422 and illustrate the results for the problem of robust sparse recovery. Key to Err codemadness.org 70 i 8423 our analysis is a combination of ideas from regularization theory and Err codemadness.org 70 i 8424 optimization in the presence of errors. Theoretical results are complemented by Err codemadness.org 70 i 8425 experiments showing that state-of-the-art performances can be achieved with Err codemadness.org 70 i 8426 considerable computational speed-ups. Err codemadness.org 70 i 8427

Err codemadness.org 70 i 8428

Socially Fair k-Means Clustering. (arXiv:2006.10085v2 [cs.LG] UPDATED)

We show that the popular k-means clustering algorithm (Lloyd's heuristic), Err codemadness.org 70 i 8435 used for a variety of scientific data, can result in outcomes that are Err codemadness.org 70 i 8436 unfavorable to subgroups of data (e.g., demographic groups). Such biased Err codemadness.org 70 i 8437 clusterings can have deleterious implications for human-centric applications Err codemadness.org 70 i 8438 such as resource allocation. We present a fair k-means objective and algorithm Err codemadness.org 70 i 8439 to choose cluster centers that provide equitable costs for different groups. Err codemadness.org 70 i 8440 The algorithm, Fair-Lloyd, is a modification of Lloyd's heuristic for k-means, Err codemadness.org 70 i 8441 inheriting its simplicity, efficiency, and stability. In comparison with Err codemadness.org 70 i 8442 standard Lloyd's, we find that on benchmark datasets, Fair-Lloyd exhibits Err codemadness.org 70 i 8443 unbiased performance by ensuring that all groups have equal costs in the output Err codemadness.org 70 i 8444 k-clustering, while incurring a negligible increase in running time, thus Err codemadness.org 70 i 8445 making it a viable fair option wherever k-means is currently used. Err codemadness.org 70 i 8446

Err codemadness.org 70 i 8447

Neutralizing Self-Selection Bias in Sampling for Sortition. (arXiv:2006.10498v2 [cs.GT] UPDATED)

Sortition is a political system in which decisions are made by panels of Err codemadness.org 70 i 8454 randomly selected citizens. The process for selecting a sortition panel is Err codemadness.org 70 i 8455 traditionally thought of as uniform sampling without replacement, which has Err codemadness.org 70 i 8456 strong fairness properties. In practice, however, sampling without replacement Err codemadness.org 70 i 8457 is not possible since only a fraction of agents is willing to participate in a Err codemadness.org 70 i 8458 panel when invited, and different demographic groups participate at different Err codemadness.org 70 i 8459 rates. In order to still produce panels whose composition resembles that of the Err codemadness.org 70 i 8460 population, we develop a sampling algorithm that restores close-to-equal Err codemadness.org 70 i 8461 representation probabilities for all agents while satisfying meaningful Err codemadness.org 70 i 8462 demographic quotas. As part of its input, our algorithm requires probabilities Err codemadness.org 70 i 8463 indicating how likely each volunteer in the pool was to participate. Since Err codemadness.org 70 i 8464 these participation probabilities are not directly observable, we show how to Err codemadness.org 70 i 8465 learn them, and demonstrate our approach using data on a real sortition panel Err codemadness.org 70 i 8466 combined with information on the general population in the form of publicly Err codemadness.org 70 i 8467 available survey data. Err codemadness.org 70 i 8468

Err codemadness.org 70 i 8469

ContraGAN: Contrastive Learning for Conditional Image Generation. (arXiv:2006.12681v2 [cs.CV] UPDATED)

Conditional image generation is the task of generating diverse images using Err codemadness.org 70 i 8476 class label information. Although many conditional Generative Adversarial Err codemadness.org 70 i 8477 Networks (GAN) have shown realistic results, such methods consider pairwise Err codemadness.org 70 i 8478 relations between the embedding of an image and the embedding of the Err codemadness.org 70 i 8479 corresponding label (data-to-class relations) as the conditioning losses. In Err codemadness.org 70 i 8480 this paper, we propose ContraGAN that considers relations between multiple Err codemadness.org 70 i 8481 image embeddings in the same batch (data-to-data relations) as well as the Err codemadness.org 70 i 8482 data-to-class relations by using a conditional contrastive loss. The Err codemadness.org 70 i 8483 discriminator of ContraGAN discriminates the authenticity of given samples and Err codemadness.org 70 i 8484 minimizes a contrastive objective to learn the relations between training Err codemadness.org 70 i 8485 images. Simultaneously, the generator tries to generate realistic images that Err codemadness.org 70 i 8486 deceive the authenticity and have a low contrastive loss. The experimental Err codemadness.org 70 i 8487 results show that ContraGAN outperforms state-of-the-art-models by 7.3% and Err codemadness.org 70 i 8488 7.7% on Tiny ImageNet and ImageNet datasets, respectively. Besides, we Err codemadness.org 70 i 8489 experimentally demonstrate that ContraGAN helps to relieve the overfitting of Err codemadness.org 70 i 8490 the discriminator. For a fair comparison, we re-implement twelve Err codemadness.org 70 i 8491 state-of-the-art GANs using the PyTorch library. The software package is Err codemadness.org 70 i 8492 available at https://github.com/POSTECH-CVLab/PyTorch-StudioGAN. Err codemadness.org 70 i 8493

Err codemadness.org 70 i 8494

Adversarial Soft Advantage Fitting: Imitation Learning without Policy Optimization. (arXiv:2006.13258v2 [cs.LG] UPDATED)

Adversarial Imitation Learning alternates between learning a discriminator -- Err codemadness.org 70 i 8501 which tells apart expert's demonstrations from generated ones -- and a Err codemadness.org 70 i 8502 generator's policy to produce trajectories that can fool this discriminator. Err codemadness.org 70 i 8503 This alternated optimization is known to be delicate in practice since it Err codemadness.org 70 i 8504 compounds unstable adversarial training with brittle and sample-inefficient Err codemadness.org 70 i 8505 reinforcement learning. We propose to remove the burden of the policy Err codemadness.org 70 i 8506 optimization steps by leveraging a novel discriminator formulation. Err codemadness.org 70 i 8507 Specifically, our discriminator is explicitly conditioned on two policies: the Err codemadness.org 70 i 8508 one from the previous generator's iteration and a learnable policy. When Err codemadness.org 70 i 8509 optimized, this discriminator directly learns the optimal generator's policy. Err codemadness.org 70 i 8510 Consequently, our discriminator's update solves the generator's optimization Err codemadness.org 70 i 8511 problem for free: learning a policy that imitates the expert does not require Err codemadness.org 70 i 8512 an additional optimization loop. This formulation effectively cuts by half the Err codemadness.org 70 i 8513 implementation and computational burden of Adversarial Imitation Learning Err codemadness.org 70 i 8514 algorithms by removing the Reinforcement Learning phase altogether. We show on Err codemadness.org 70 i 8515 a variety of tasks that our simpler approach is competitive to prevalent Err codemadness.org 70 i 8516 Imitation Learning methods. Err codemadness.org 70 i 8517

Err codemadness.org 70 i 8518

Relative Deviation Margin Bounds. (arXiv:2006.14950v2 [cs.LG] UPDATED)

We present a series of new and more favorable margin-based learning Err codemadness.org 70 i 8525 guarantees that depend on the empirical margin loss of a predictor. We give two Err codemadness.org 70 i 8526 types of learning bounds, both distribution-dependent and valid for general Err codemadness.org 70 i 8527 families, in terms of the Rademacher complexity or the empirical $\ell_\infty$ Err codemadness.org 70 i 8528 covering number of the hypothesis set used. Furthermore, using our relative Err codemadness.org 70 i 8529 deviation margin bounds, we derive distribution-dependent generalization bounds Err codemadness.org 70 i 8530 for unbounded loss functions under the assumption of a finite moment. We also Err codemadness.org 70 i 8531 briefly highlight several applications of these bounds and discuss their Err codemadness.org 70 i 8532 connection with existing results. Err codemadness.org 70 i 8533

Err codemadness.org 70 i 8534

Weighted hypersoft configuration model. (arXiv:2007.00124v2 [physics.soc-ph] UPDATED)

Maximum entropy null models of networks come in different flavors that depend Err codemadness.org 70 i 8541 on the type of constraints under which entropy is maximized. If the constraints Err codemadness.org 70 i 8542 are on degree sequences or distributions, we are dealing with configuration Err codemadness.org 70 i 8543 models. If the degree sequence is constrained exactly, the corresponding Err codemadness.org 70 i 8544 microcanonical ensemble of random graphs with a given degree sequence is the Err codemadness.org 70 i 8545 configuration model per se. If the degree sequence is constrained only on Err codemadness.org 70 i 8546 average, the corresponding grand-canonical ensemble of random graphs with a Err codemadness.org 70 i 8547 given expected degree sequence is the soft configuration model. If the degree Err codemadness.org 70 i 8548 sequence is not fixed at all but randomly drawn from a fixed distribution, the Err codemadness.org 70 i 8549 corresponding hypercanonical ensemble of random graphs with a given degree Err codemadness.org 70 i 8550 distribution is the hypersoft configuration model, a more adequate description Err codemadness.org 70 i 8551 of dynamic real-world networks in which degree sequences are never fixed but Err codemadness.org 70 i 8552 degree distributions often stay stable. Here, we introduce the hypersoft Err codemadness.org 70 i 8553 configuration model of weighted networks. The main contribution is a particular Err codemadness.org 70 i 8554 version of the model with power-law degree and strength distributions, and Err codemadness.org 70 i 8555 superlinear scaling of strengths with degrees, mimicking the properties of some Err codemadness.org 70 i 8556 real-world networks. As a byproduct, we generalize the notions of sparse Err codemadness.org 70 i 8557 graphons and their entropy to weighted networks. Err codemadness.org 70 i 8558

Err codemadness.org 70 i 8559

Robustness against Relational Adversary. (arXiv:2007.00772v2 [cs.LG] UPDATED)

Test-time adversarial attacks have posed serious challenges to the robustness Err codemadness.org 70 i 8566 of machine-learning models, and in many settings the adversarial perturbation Err codemadness.org 70 i 8567 need not be bounded by small $\ell_p$-norms. Motivated by the Err codemadness.org 70 i 8568 semantics-preserving attacks in vision and security domain, we investigate Err codemadness.org 70 i 8569 $\textit{relational adversaries}$, a broad class of attackers who create Err codemadness.org 70 i 8570 adversarial examples that are in a reflexive-transitive closure of a logical Err codemadness.org 70 i 8571 relation. We analyze the conditions for robustness and propose Err codemadness.org 70 i 8572 $\textit{normalize-and-predict}$ -- a learning framework with provable Err codemadness.org 70 i 8573 robustness guarantee. We compare our approach with adversarial training and Err codemadness.org 70 i 8574 derive an unified framework that provides benefits of both approaches. Guided Err codemadness.org 70 i 8575 by our theoretical findings, we apply our framework to image classification and Err codemadness.org 70 i 8576 malware detection. Results of both tasks show that attacks using relational Err codemadness.org 70 i 8577 adversaries frequently fool existing models, but our unified framework can Err codemadness.org 70 i 8578 significantly enhance their robustness. Err codemadness.org 70 i 8579

Err codemadness.org 70 i 8580

Information Theoretic Lower Bounds for Feed-Forward Fully-Connected Deep Networks. (arXiv:2007.00796v2 [stat.ML] UPDATED)

In this paper, we study the sample complexity lower bounds for the exact Err codemadness.org 70 i 8587 recovery of parameters and for a positive excess risk of a feed-forward, Err codemadness.org 70 i 8588 fully-connected neural network for binary classification, using Err codemadness.org 70 i 8589 information-theoretic tools. We prove these lower bounds by the existence of a Err codemadness.org 70 i 8590 generative network characterized by a backwards data generating process, where Err codemadness.org 70 i 8591 the input is generated based on the binary output, and the network is Err codemadness.org 70 i 8592 parametrized by weight parameters for the hidden layers. The sample complexity Err codemadness.org 70 i 8593 lower bound for the exact recovery of parameters is $\Omega(d r \log(r) + p )$ Err codemadness.org 70 i 8594 and for a positive excess risk is $\Omega(r \log(r) + p )$, where $p$ is the Err codemadness.org 70 i 8595 dimension of the input, $r$ reflects the rank of the weight matrices and $d$ is Err codemadness.org 70 i 8596 the number of hidden layers. To the best of our knowledge, our results are the Err codemadness.org 70 i 8597 first information theoretic lower bounds. Err codemadness.org 70 i 8598

Err codemadness.org 70 i 8599

Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning. (arXiv:2007.01293v2 [cs.LG] UPDATED)

Existing semi-supervised learning (SSL) algorithms use a single weight to Err codemadness.org 70 i 8606 balance the loss of labeled and unlabeled examples, i.e., all unlabeled Err codemadness.org 70 i 8607 examples are equally weighted. But not all unlabeled data are equal. In this Err codemadness.org 70 i 8608 paper we study how to use a different weight for every unlabeled example. Err codemadness.org 70 i 8609 Manual tuning of all those weights -- as done in prior work -- is no longer Err codemadness.org 70 i 8610 possible. Instead, we adjust those weights via an algorithm based on the Err codemadness.org 70 i 8611 influence function, a measure of a model's dependency on one training example. Err codemadness.org 70 i 8612 To make the approach efficient, we propose a fast and effective approximation Err codemadness.org 70 i 8613 of the influence function. We demonstrate that this technique outperforms Err codemadness.org 70 i 8614 state-of-the-art methods on semi-supervised image and language classification Err codemadness.org 70 i 8615 tasks. Err codemadness.org 70 i 8616

Err codemadness.org 70 i 8617

A Framework for Modelling, Verification and Transformation of Concurrent Imperative Programs. (arXiv:2007.02261v2 [cs.LO] UPDATED)

The paper gives a comprehensive presentation of a framework, embedded into Err codemadness.org 70 i 8624 the simply typed higher-order logic, and aimed at providing a sound assistance Err codemadness.org 70 i 8625 in formal reasoning about models of imperative programs with interleaved Err codemadness.org 70 i 8626 computations. As a case study, a model of the Peterson's mutual exclusion Err codemadness.org 70 i 8627 algorithm will be scrutinised in the course of the paper illustrating Err codemadness.org 70 i 8628 applicability of the framework. Err codemadness.org 70 i 8629

Err codemadness.org 70 i 8630

Self-Supervised Graph Transformer on Large-Scale Molecular Data. (arXiv:2007.02835v2 [q-bio.BM] UPDATED)

How to obtain informative representations of molecules is a crucial Err codemadness.org 70 i 8637 prerequisite in AI-driven drug design and discovery. Recent researches abstract Err codemadness.org 70 i 8638 molecules as graphs and employ Graph Neural Networks (GNNs) for molecular Err codemadness.org 70 i 8639 representation learning. Nevertheless, two issues impede the usage of GNNs in Err codemadness.org 70 i 8640 real scenarios: (1) insufficient labeled molecules for supervised training; (2) Err codemadness.org 70 i 8641 poor generalization capability to new-synthesized molecules. To address them Err codemadness.org 70 i 8642 both, we propose a novel framework, GROVER, which stands for Graph Err codemadness.org 70 i 8643 Representation frOm self-superVised mEssage passing tRansformer. With carefully Err codemadness.org 70 i 8644 designed self-supervised tasks in node-, edge- and graph-level, GROVER can Err codemadness.org 70 i 8645 learn rich structural and semantic information of molecules from enormous Err codemadness.org 70 i 8646 unlabelled molecular data. Rather, to encode such complex information, GROVER Err codemadness.org 70 i 8647 integrates Message Passing Networks into the Transformer-style architecture to Err codemadness.org 70 i 8648 deliver a class of more expressive encoders of molecules. The flexibility of Err codemadness.org 70 i 8649 GROVER allows it to be trained efficiently on large-scale molecular dataset Err codemadness.org 70 i 8650 without requiring any supervision, thus being immunized to the two issues Err codemadness.org 70 i 8651 mentioned above. We pre-train GROVER with 100 million parameters on 10 million Err codemadness.org 70 i 8652 unlabelled molecules -- the biggest GNN and the largest training dataset in Err codemadness.org 70 i 8653 molecular representation learning. We then leverage the pre-trained GROVER for Err codemadness.org 70 i 8654 molecular property prediction followed by task-specific fine-tuning, where we Err codemadness.org 70 i 8655 observe a huge improvement (more than 6% on average) from current Err codemadness.org 70 i 8656 state-of-the-art methods on 11 challenging benchmarks. The insights we gained Err codemadness.org 70 i 8657 are that well-designed self-supervision losses and largely-expressive Err codemadness.org 70 i 8658 pre-trained models enjoy the significant potential on performance boosting. Err codemadness.org 70 i 8659

Err codemadness.org 70 i 8660

BoxE: A Box Embedding Model for Knowledge Base Completion. (arXiv:2007.06267v2 [cs.AI] UPDATED)

Knowledge base completion (KBC) aims to automatically infer missing facts by Err codemadness.org 70 i 8667 exploiting information already present in a knowledge base (KB). A promising Err codemadness.org 70 i 8668 approach for KBC is to embed knowledge into latent spaces and make predictions Err codemadness.org 70 i 8669 from learned embeddings. However, existing embedding models are subject to at Err codemadness.org 70 i 8670 least one of the following limitations: (1) theoretical inexpressivity, (2) Err codemadness.org 70 i 8671 lack of support for prominent inference patterns (e.g., hierarchies), (3) lack Err codemadness.org 70 i 8672 of support for KBC over higher-arity relations, and (4) lack of support for Err codemadness.org 70 i 8673 incorporating logical rules. Here, we propose a spatio-translational embedding Err codemadness.org 70 i 8674 model, called BoxE, that simultaneously addresses all these limitations. BoxE Err codemadness.org 70 i 8675 embeds entities as points, and relations as a set of hyper-rectangles (or Err codemadness.org 70 i 8676 boxes), which spatially characterize basic logical properties. This seemingly Err codemadness.org 70 i 8677 simple abstraction yields a fully expressive model offering a natural encoding Err codemadness.org 70 i 8678 for many desired logical properties. BoxE can both capture and inject rules Err codemadness.org 70 i 8679 from rich classes of rule languages, going well beyond individual inference Err codemadness.org 70 i 8680 patterns. By design, BoxE naturally applies to higher-arity KBs. We conduct a Err codemadness.org 70 i 8681 detailed experimental analysis, and show that BoxE achieves state-of-the-art Err codemadness.org 70 i 8682 performance, both on benchmark knowledge graphs and on more general KBs, and we Err codemadness.org 70 i 8683 empirically show the power of integrating logical rules. Err codemadness.org 70 i 8684

Err codemadness.org 70 i 8685

RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning. (arXiv:2007.06271v2 [cs.CV] UPDATED)

Research on continual learning has led to a variety of approaches to Err codemadness.org 70 i 8692 mitigating catastrophic forgetting in feed-forward classification networks. Err codemadness.org 70 i 8693 Until now surprisingly little attention has been focused on continual learning Err codemadness.org 70 i 8694 of recurrent models applied to problems like image captioning. In this paper we Err codemadness.org 70 i 8695 take a systematic look at continual learning of LSTM-based models for image Err codemadness.org 70 i 8696 captioning. We propose an attention-based approach that explicitly accommodates Err codemadness.org 70 i 8697 the transient nature of vocabularies in continual image captioning tasks -- Err codemadness.org 70 i 8698 i.e. that task vocabularies are not disjoint. We call our method Recurrent Err codemadness.org 70 i 8699 Attention to Transient Tasks (RATT), and also show how to adapt continual Err codemadness.org 70 i 8700 learning approaches based on weight egularization and knowledge distillation to Err codemadness.org 70 i 8701 recurrent continual learning problems. We apply our approaches to incremental Err codemadness.org 70 i 8702 image captioning problem on two new continual learning benchmarks we define Err codemadness.org 70 i 8703 using the MS-COCO and Flickr30 datasets. Our results demonstrate that RATT is Err codemadness.org 70 i 8704 able to sequentially learn five captioning tasks while incurring no forgetting Err codemadness.org 70 i 8705 of previously learned ones. Err codemadness.org 70 i 8706

Err codemadness.org 70 i 8707

Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical Analysis. (arXiv:2007.07632v2 [cs.IT] UPDATED)

Deep learning has recently emerged as a disruptive technology to solve Err codemadness.org 70 i 8714 challenging radio resource management problems in wireless networks. However, Err codemadness.org 70 i 8715 the neural network architectures adopted by existing works suffer from poor Err codemadness.org 70 i 8716 scalability, generalization, and lack of interpretability. A long-standing Err codemadness.org 70 i 8717 approach to improve scalability and generalization is to incorporate the Err codemadness.org 70 i 8718 structures of the target task into the neural network architecture. In this Err codemadness.org 70 i 8719 paper, we propose to apply graph neural networks (GNNs) to solve large-scale Err codemadness.org 70 i 8720 radio resource management problems, supported by effective neural network Err codemadness.org 70 i 8721 architecture design and theoretical analysis. Specifically, we first Err codemadness.org 70 i 8722 demonstrate that radio resource management problems can be formulated as graph Err codemadness.org 70 i 8723 optimization problems that enjoy a universal permutation equivariance property. Err codemadness.org 70 i 8724 We then identify a class of neural networks, named \emph{message passing graph Err codemadness.org 70 i 8725 neural networks} (MPGNNs). It is demonstrated that they not only satisfy the Err codemadness.org 70 i 8726 permutation equivariance property, but also can generalize to large-scale Err codemadness.org 70 i 8727 problems while enjoying a high computational efficiency. For interpretablity Err codemadness.org 70 i 8728 and theoretical guarantees, we prove the equivalence between MPGNNs and a class Err codemadness.org 70 i 8729 of distributed optimization algorithms, which is then used to analyze the Err codemadness.org 70 i 8730 performance and generalization of MPGNN-based methods. Extensive simulations, Err codemadness.org 70 i 8731 with power control and beamforming as two examples, will demonstrate that the Err codemadness.org 70 i 8732 proposed method, trained in an unsupervised manner with unlabeled samples, Err codemadness.org 70 i 8733 matches or even outperforms classic optimization-based algorithms without Err codemadness.org 70 i 8734 domain-specific knowledge. Remarkably, the proposed method is highly scalable Err codemadness.org 70 i 8735 and can solve the beamforming problem in an interference channel with $1000$ Err codemadness.org 70 i 8736 transceiver pairs within $6$ milliseconds on a single GPU. Err codemadness.org 70 i 8737

Err codemadness.org 70 i 8738

Temporal Pointwise Convolutional Networks for Length of Stay Prediction in the Intensive Care Unit. (arXiv:2007.09483v2 [cs.LG] UPDATED)

The pressure of ever-increasing patient demand and budget restrictions make Err codemadness.org 70 i 8745 hospital bed management a daily challenge for clinical staff. Most critical is Err codemadness.org 70 i 8746 the efficient allocation of resource-heavy Intensive Care Unit (ICU) beds to Err codemadness.org 70 i 8747 the patients who need life support. Central to solving this problem is knowing Err codemadness.org 70 i 8748 for how long the current set of ICU patients are likely to stay in the unit. In Err codemadness.org 70 i 8749 this work, we propose a new deep learning model based on the combination of Err codemadness.org 70 i 8750 temporal convolution and pointwise (1x1) convolution, to solve the length of Err codemadness.org 70 i 8751 stay prediction task on the eICU critical care dataset. The model - which we Err codemadness.org 70 i 8752 refer to as Temporal Pointwise Convolution (TPC) - is specifically designed to Err codemadness.org 70 i 8753 mitigate for common challenges with Electronic Health Records, such as Err codemadness.org 70 i 8754 skewness, irregular sampling and missing data. In doing so, we have achieved Err codemadness.org 70 i 8755 significant performance benefits of 18-51% (metric dependent) over the commonly Err codemadness.org 70 i 8756 used Long-Short Term Memory (LSTM) network, and the multi-head self-attention Err codemadness.org 70 i 8757 network known as the Transformer. Err codemadness.org 70 i 8758

Err codemadness.org 70 i 8759

CovidDeep: SARS-CoV-2/COVID-19 Test Based on Wearable Medical Sensors and Efficient Neural Networks. (arXiv:2007.10497v3 [cs.HC] UPDATED)

The novel coronavirus (SARS-CoV-2) has led to a pandemic. The current testing Err codemadness.org 70 i 8766 regime based on Reverse Transcription-Polymerase Chain Reaction for SARS-CoV-2 Err codemadness.org 70 i 8767 has been unable to keep up with testing demands, and also suffers from a Err codemadness.org 70 i 8768 relatively low positive detection rate in the early stages of the resultant Err codemadness.org 70 i 8769 COVID-19 disease. Hence, there is a need for an alternative approach for Err codemadness.org 70 i 8770 repeated large-scale testing of SARS-CoV-2/COVID-19. We propose a framework Err codemadness.org 70 i 8771 called CovidDeep that combines efficient DNNs with commercially available WMSs Err codemadness.org 70 i 8772 for pervasive testing of the virus. We collected data from 87 individuals, Err codemadness.org 70 i 8773 spanning three cohorts including healthy, asymptomatic, and symptomatic Err codemadness.org 70 i 8774 patients. We trained DNNs on various subsets of the features automatically Err codemadness.org 70 i 8775 extracted from six WMS and questionnaire categories to perform ablation studies Err codemadness.org 70 i 8776 to determine which subsets are most efficacious in terms of test accuracy for a Err codemadness.org 70 i 8777 three-way classification. The highest test accuracy obtained was 98.1%. We also Err codemadness.org 70 i 8778 augmented the real training dataset with a synthetic training dataset drawn Err codemadness.org 70 i 8779 from the same probability distribution to impose a prior on DNN weights and Err codemadness.org 70 i 8780 leveraged a grow-and-prune synthesis paradigm to learn both DNN architecture Err codemadness.org 70 i 8781 and weights. This boosted the accuracy of the various DNNs further and Err codemadness.org 70 i 8782 simultaneously reduced their size and floating-point operations. Err codemadness.org 70 i 8783

Err codemadness.org 70 i 8784

The Complete Lasso Tradeoff Diagram. (arXiv:2007.11078v4 [math.ST] UPDATED)

A fundamental problem in the high-dimensional regression is to understand the Err codemadness.org 70 i 8791 tradeoff between type I and type II errors or, equivalently, false discovery Err codemadness.org 70 i 8792 rate (FDR) and power in variable selection. To address this important problem, Err codemadness.org 70 i 8793 we offer the first complete tradeoff diagram that distinguishes all pairs of Err codemadness.org 70 i 8794 FDR and power that can be asymptotically realized by the Lasso with some choice Err codemadness.org 70 i 8795 of its penalty parameter from the remaining pairs, in a regime of linear Err codemadness.org 70 i 8796 sparsity under random designs. The tradeoff between the FDR and power Err codemadness.org 70 i 8797 characterized by our diagram holds no matter how strong the signals are. In Err codemadness.org 70 i 8798 particular, our results improve on the earlier Lasso tradeoff diagram of Err codemadness.org 70 i 8799 arXiv:1511.01957 by recognizing two simple but fundamental constraints on the Err codemadness.org 70 i 8800 pairs of FDR and power. The improvement is more substantial when the regression Err codemadness.org 70 i 8801 problem is above the Donoho--Tanner phase transition. Finally, we present Err codemadness.org 70 i 8802 extensive simulation studies to confirm the sharpness of the complete Lasso Err codemadness.org 70 i 8803 tradeoff diagram. Err codemadness.org 70 i 8804

Err codemadness.org 70 i 8805

Sifting Convolution on the Sphere. (arXiv:2007.12153v2 [cs.IT] UPDATED)

A novel spherical convolution is defined through the sifting property of the Err codemadness.org 70 i 8812 Dirac delta on the sphere. The so-called sifting convolution is defined by the Err codemadness.org 70 i 8813 inner product of one function with a translated version of another, but with Err codemadness.org 70 i 8814 the adoption of an alternative translation operator on the sphere. This Err codemadness.org 70 i 8815 translation operator follows by analogy with the Euclidean translation when Err codemadness.org 70 i 8816 viewed in harmonic space. The sifting convolution satisfies a variety of Err codemadness.org 70 i 8817 desirable properties that are lacking in alternate definitions, namely: it Err codemadness.org 70 i 8818 supports directional kernels; it has an output which remains on the sphere; and Err codemadness.org 70 i 8819 is efficient to compute. An illustration of the sifting convolution on a Err codemadness.org 70 i 8820 topographic map of the Earth demonstrates that it supports directional kernels Err codemadness.org 70 i 8821 to perform anisotropic filtering, while its output remains on the sphere. Err codemadness.org 70 i 8822

Err codemadness.org 70 i 8823

Revisiting Locality in Binary-Integer Representations. (arXiv:2007.12159v2 [cs.NE] UPDATED)

Mutation and recombination operators play a key role in determining the speed Err codemadness.org 70 i 8830 and quality of Genetic and Evolutionary Algorithms (GEAs). Prior work has Err codemadness.org 70 i 8831 analyzed the effects of these operators on genotypic variation, often using Err codemadness.org 70 i 8832 locality metrics that measure the sensitivity and stability of Err codemadness.org 70 i 8833 genotype-phenotype representations to these operators. Err codemadness.org 70 i 8834

Err codemadness.org 70 i 8835

In this paper, we focus on an important subset of representations, namely Err codemadness.org 70 i 8836 nonredundant bitstring-to-integer representations, and analyze them through the Err codemadness.org 70 i 8837 lens of Rothlauf's widely used locality metrics. We first define locality Err codemadness.org 70 i 8838 metrics equivalent to Rothlauf's that are tailored to our domain: the Err codemadness.org 70 i 8839 \textit{point locality} for single-bit mutation and \textit{general locality} Err codemadness.org 70 i 8840 for recombination. With these definitions, we derive tight bounds and a closed Err codemadness.org 70 i 8841 form expected value for point locality. For general locality we show that it is Err codemadness.org 70 i 8842 asymptotically equivalent across all representations and operators. We also Err codemadness.org 70 i 8843 recreate three established GEA experiments to understand the predictive power Err codemadness.org 70 i 8844 of point locality on GEA performance, focusing on two popular and often Err codemadness.org 70 i 8845 juxtaposed representations: standard binary and binary reflected Gray. Err codemadness.org 70 i 8846

Err codemadness.org 70 i 8847

We show that standard binary has provably no worse locality than any Gray Err codemadness.org 70 i 8848 encoding, including binary reflected Gray. We discuss this result in the Err codemadness.org 70 i 8849 context of previous studies that found binary reflected Gray to outperform Err codemadness.org 70 i 8850 standard binary, and we argue that locality cannot be the explanation for Err codemadness.org 70 i 8851 strong performance. Finally, we provide empirical evidence that weak point Err codemadness.org 70 i 8852 locality representations can be beneficial to performance in the exploration Err codemadness.org 70 i 8853 phase of the GEA, while strong point locality representations are more Err codemadness.org 70 i 8854 beneficial in the exploitation phase. Err codemadness.org 70 i 8855

Err codemadness.org 70 i 8856

YOLOpeds: Efficient Real-Time Single-Shot Pedestrian Detection for Smart Camera Applications. (arXiv:2007.13404v2 [cs.CV] UPDATED)

Deep Learning-based object detectors can enhance the capabilities of smart Err codemadness.org 70 i 8863 camera systems in a wide spectrum of machine vision applications including Err codemadness.org 70 i 8864 video surveillance, autonomous driving, robots and drones, smart factory, and Err codemadness.org 70 i 8865 health monitoring. Pedestrian detection plays a key role in all these Err codemadness.org 70 i 8866 applications and deep learning can be used to construct accurate Err codemadness.org 70 i 8867 state-of-the-art detectors. However, such complex paradigms do not scale easily Err codemadness.org 70 i 8868 and are not traditionally implemented in resource-constrained smart cameras for Err codemadness.org 70 i 8869 on-device processing which offers significant advantages in situations when Err codemadness.org 70 i 8870 real-time monitoring and robustness are vital. Efficient neural networks can Err codemadness.org 70 i 8871 not only enable mobile applications and on-device experiences but can also be a Err codemadness.org 70 i 8872 key enabler of privacy and security allowing a user to gain the benefits of Err codemadness.org 70 i 8873 neural networks without needing to send their data to the server to be Err codemadness.org 70 i 8874 evaluated. This work addresses the challenge of achieving a good trade-off Err codemadness.org 70 i 8875 between accuracy and speed for efficient deployment of deep-learning-based Err codemadness.org 70 i 8876 pedestrian detection in smart camera applications. A computationally efficient Err codemadness.org 70 i 8877 architecture is introduced based on separable convolutions and proposes Err codemadness.org 70 i 8878 integrating dense connections across layers and multi-scale feature fusion to Err codemadness.org 70 i 8879 improve representational capacity while decreasing the number of parameters and Err codemadness.org 70 i 8880 operations. In particular, the contributions of this work are the following: 1) Err codemadness.org 70 i 8881 An efficient backbone combining multi-scale feature operations, 2) a more Err codemadness.org 70 i 8882 elaborate loss function for improved localization, 3) an anchor-less approach Err codemadness.org 70 i 8883 for detection, The proposed approach called YOLOpeds is evaluated using the Err codemadness.org 70 i 8884 PETS2009 surveillance dataset on 320x320 images. Overall, YOLOpeds provides Err codemadness.org 70 i 8885 real-time sustained operation of over 30 frames per second with detection rates Err codemadness.org 70 i 8886 in the range of 86% outperforming existing deep learning models. Err codemadness.org 70 i 8887

Err codemadness.org 70 i 8888

Regularization by Denoising via Fixed-Point Projection (RED-PRO). (arXiv:2008.00226v2 [eess.IV] UPDATED)

Inverse problems in image processing are typically cast as optimization Err codemadness.org 70 i 8895 tasks, consisting of data-fidelity and stabilizing regularization terms. A Err codemadness.org 70 i 8896 recent regularization strategy of great interest utilizes the power of Err codemadness.org 70 i 8897 denoising engines. Two such methods are the Plug-and-Play Prior (PnP) and Err codemadness.org 70 i 8898 Regularization by Denoising (RED). While both have shown state-of-the-art Err codemadness.org 70 i 8899 results in various recovery tasks, their theoretical justification is Err codemadness.org 70 i 8900 incomplete. In this paper, we aim to bridge between RED and PnP, enriching the Err codemadness.org 70 i 8901 understanding of both frameworks. Towards that end, we reformulate RED as a Err codemadness.org 70 i 8902 convex optimization problem utilizing a projection (RED-PRO) onto the Err codemadness.org 70 i 8903 fixed-point set of demicontractive denoisers. We offer a simple iterative Err codemadness.org 70 i 8904 solution to this problem, by which we show that PnP proximal gradient method is Err codemadness.org 70 i 8905 a special case of RED-PRO, while providing guarantees for the convergence of Err codemadness.org 70 i 8906 both frameworks to globally optimal solutions. In addition, we present Err codemadness.org 70 i 8907 relaxations of RED-PRO that allow for handling denoisers with limited Err codemadness.org 70 i 8908 fixed-point sets. Finally, we demonstrate RED-PRO for the tasks of image Err codemadness.org 70 i 8909 deblurring and super-resolution, showing improved results with respect to the Err codemadness.org 70 i 8910 original RED framework. Err codemadness.org 70 i 8911

Err codemadness.org 70 i 8912

A Matrix Chernoff Bound for Markov Chains and Its Application to Co-occurrence Matrices. (arXiv:2008.02464v2 [stat.ML] UPDATED)

We prove a Chernoff-type bound for sums of matrix-valued random variables Err codemadness.org 70 i 8919 sampled via a regular (aperiodic and irreducible) finite Markov chain. Err codemadness.org 70 i 8920 Specially, consider a random walk on a regular Markov chain and a Hermitian Err codemadness.org 70 i 8921 matrix-valued function on its state space. Our result gives exponentially Err codemadness.org 70 i 8922 decreasing bounds on the tail distributions of the extreme eigenvalues of the Err codemadness.org 70 i 8923 sample mean matrix. Our proof is based on the matrix expander (regular Err codemadness.org 70 i 8924 undirected graph) Chernoff bound [Garg et al. STOC '18] and scalar Err codemadness.org 70 i 8925 Chernoff-Hoeffding bounds for Markov chains [Chung et al. STACS '12]. Err codemadness.org 70 i 8926

Err codemadness.org 70 i 8927

Our matrix Chernoff bound for Markov chains can be applied to analyze the Err codemadness.org 70 i 8928 behavior of co-occurrence statistics for sequential data, which have been Err codemadness.org 70 i 8929 common and important data signals in machine learning. We show that given a Err codemadness.org 70 i 8930 regular Markov chain with $n$ states and mixing time $\tau$, we need a Err codemadness.org 70 i 8931 trajectory of length $O(\tau (\log{(n)}+\log{(\tau)})/\epsilon^2)$ to achieve Err codemadness.org 70 i 8932 an estimator of the co-occurrence matrix with error bound $\epsilon$. We Err codemadness.org 70 i 8933 conduct several experiments and the experimental results are consistent with Err codemadness.org 70 i 8934 the exponentially fast convergence rate from theoretical analysis. Our result Err codemadness.org 70 i 8935 gives the first bound on the convergence rate of the co-occurrence matrix and Err codemadness.org 70 i 8936 the first sample complexity analysis in graph representation learning. Err codemadness.org 70 i 8937

Err codemadness.org 70 i 8938

Integration of the 3D Environment for UAV Onboard Visual Object Tracking. (arXiv:2008.02834v3 [cs.CV] UPDATED)

Single visual object tracking from an unmanned aerial vehicle (UAV) poses Err codemadness.org 70 i 8945 fundamental challenges such as object occlusion, small-scale objects, Err codemadness.org 70 i 8946 background clutter, and abrupt camera motion. To tackle these difficulties, we Err codemadness.org 70 i 8947 propose to integrate the 3D structure of the observed scene into a Err codemadness.org 70 i 8948 detection-by-tracking algorithm. We introduce a pipeline that combines a Err codemadness.org 70 i 8949 model-free visual object tracker, a sparse 3D reconstruction, and a state Err codemadness.org 70 i 8950 estimator. The 3D reconstruction of the scene is computed with an image-based Err codemadness.org 70 i 8951 Structure-from-Motion (SfM) component that enables us to leverage a state Err codemadness.org 70 i 8952 estimator in the corresponding 3D scene during tracking. By representing the Err codemadness.org 70 i 8953 position of the target in 3D space rather than in image space, we stabilize the Err codemadness.org 70 i 8954 tracking during ego-motion and improve the handling of occlusions, background Err codemadness.org 70 i 8955 clutter, and small-scale objects. We evaluated our approach on prototypical Err codemadness.org 70 i 8956 image sequences, captured from a UAV with low-altitude oblique views. For this Err codemadness.org 70 i 8957 purpose, we adapted an existing dataset for visual object tracking and Err codemadness.org 70 i 8958 reconstructed the observed scene in 3D. The experimental results demonstrate Err codemadness.org 70 i 8959 that the proposed approach outperforms methods using plain visual cues as well Err codemadness.org 70 i 8960 as approaches leveraging image-space-based state estimations. We believe that Err codemadness.org 70 i 8961 our approach can be beneficial for traffic monitoring, video surveillance, and Err codemadness.org 70 i 8962 navigation. Err codemadness.org 70 i 8963

Err codemadness.org 70 i 8964

Lifted Multiplicity Codes. (arXiv:2008.04717v2 [cs.IT] UPDATED)

Lifted Reed-Solomon codes and multiplicity codes are two classes of Err codemadness.org 70 i 8971 evaluation codes that allow for the design of high-rate codes that can recover Err codemadness.org 70 i 8972 every codeword or information symbol from many disjoint sets. Recently, the Err codemadness.org 70 i 8973 underlying approaches have been combined to construct lifted bi-variate Err codemadness.org 70 i 8974 multiplicity codes, that can further improve on the rate. We continue the study Err codemadness.org 70 i 8975 of these codes by providing lower bounds on the rate and distance for lifted Err codemadness.org 70 i 8976 multiplicity codes obtained from polynomials in an arbitrary number of Err codemadness.org 70 i 8977 variables. Specifically, we investigate a subcode of a lifted multiplicity code Err codemadness.org 70 i 8978 formed by the linear span of $m$-variate monomials whose restriction to an Err codemadness.org 70 i 8979 arbitrary line in $\mathbb{F}_q^m$ is equivalent to a low-degree uni-variate Err codemadness.org 70 i 8980 polynomial. We find the tight asymptotic behavior of the fraction of such Err codemadness.org 70 i 8981 monomials when the number of variables $m$ is fixed and the alphabet size Err codemadness.org 70 i 8982 $q=2^\ell$ is large. For some parameter regimes, lifted multiplicity codes are Err codemadness.org 70 i 8983 then shown to have a better trade-off between redundancy and the number of Err codemadness.org 70 i 8984 disjoint recovering sets for every codeword or information symbol than Err codemadness.org 70 i 8985 previously known constructions. Additionally, we present a local Err codemadness.org 70 i 8986 self-correction algorithm for lifted multiplicity codes. Err codemadness.org 70 i 8987

Err codemadness.org 70 i 8988

A Composable Specification Language for Reinforcement Learning Tasks. (arXiv:2008.09293v2 [cs.LG] UPDATED)

Reinforcement learning is a promising approach for learning control policies Err codemadness.org 70 i 8995 for robot tasks. However, specifying complex tasks (e.g., with multiple Err codemadness.org 70 i 8996 objectives and safety constraints) can be challenging, since the user must Err codemadness.org 70 i 8997 design a reward function that encodes the entire task. Furthermore, the user Err codemadness.org 70 i 8998 often needs to manually shape the reward to ensure convergence of the learning Err codemadness.org 70 i 8999 algorithm. We propose a language for specifying complex control tasks, along Err codemadness.org 70 i 9000 with an algorithm that compiles specifications in our language into a reward Err codemadness.org 70 i 9001 function and automatically performs reward shaping. We implement our approach Err codemadness.org 70 i 9002 in a tool called SPECTRL, and show that it outperforms several state-of-the-art Err codemadness.org 70 i 9003 baselines. Err codemadness.org 70 i 9004

Err codemadness.org 70 i 9005

Gravilon: Applications of a New Gradient Descent Method to Machine Learning. (arXiv:2008.11370v2 [cs.LG] UPDATED)

Gradient descent algorithms have been used in countless applications since Err codemadness.org 70 i 9012 the inception of Newton's method. The explosion in the number of applications Err codemadness.org 70 i 9013 of neural networks has re-energized efforts in recent years to improve the Err codemadness.org 70 i 9014 standard gradient descent method in both efficiency and accuracy. These methods Err codemadness.org 70 i 9015 modify the effect of the gradient in updating the values of the parameters. Err codemadness.org 70 i 9016 These modifications often incorporate hyperparameters: additional variables Err codemadness.org 70 i 9017 whose values must be specified at the outset of the program. We provide, below, Err codemadness.org 70 i 9018 a novel gradient descent algorithm, called Gravilon, that uses the geometry of Err codemadness.org 70 i 9019 the hypersurface to modify the length of the step in the direction of the Err codemadness.org 70 i 9020 gradient. Using neural networks, we provide promising experimental results Err codemadness.org 70 i 9021 comparing the accuracy and efficiency of the Gravilon method against commonly Err codemadness.org 70 i 9022 used gradient descent algorithms on MNIST digit classification. Err codemadness.org 70 i 9023

Err codemadness.org 70 i 9024

On the model-based stochastic value gradient for continuous reinforcement learning. (arXiv:2008.12775v2 [cs.LG] UPDATED)

Model-based reinforcement learning approaches add explicit domain knowledge Err codemadness.org 70 i 9031 to agents in hopes of improving the sample-efficiency in comparison to Err codemadness.org 70 i 9032 model-free agents. However, in practice model-based methods are unable to Err codemadness.org 70 i 9033 achieve the same asymptotic performance on challenging continuous control tasks Err codemadness.org 70 i 9034 due to the complexity of learning and controlling an explicit world model. In Err codemadness.org 70 i 9035 this paper we investigate the stochastic value gradient (SVG), which is a Err codemadness.org 70 i 9036 well-known family of methods for controlling continuous systems which includes Err codemadness.org 70 i 9037 model-based approaches that distill a model-based value expansion into a Err codemadness.org 70 i 9038 model-free policy. We consider a variant of the model-based SVG that scales to Err codemadness.org 70 i 9039 larger systems and uses 1) an entropy regularization to help with exploration, Err codemadness.org 70 i 9040 2) a learned deterministic world model to improve the short-horizon value Err codemadness.org 70 i 9041 estimate, and 3) a learned model-free value estimate after the model's rollout. Err codemadness.org 70 i 9042 This SVG variation captures the model-free soft actor-critic method as an Err codemadness.org 70 i 9043 instance when the model rollout horizon is zero, and otherwise uses Err codemadness.org 70 i 9044 short-horizon model rollouts to improve the value estimate for the policy Err codemadness.org 70 i 9045 update. We surpass the asymptotic performance of other model-based methods on Err codemadness.org 70 i 9046 the proprioceptive MuJoCo locomotion tasks from the OpenAI gym, including a Err codemadness.org 70 i 9047 humanoid. We notably achieve these results with a simple deterministic world Err codemadness.org 70 i 9048 model without requiring an ensemble. Err codemadness.org 70 i 9049

Err codemadness.org 70 i 9050

Introduction to logistic regression. (arXiv:2008.13567v2 [stat.ME] UPDATED)

For random field theory based multiple comparison corrections In brain Err codemadness.org 70 i 9057 imaging, it is often necessary to compute the distribution of the supremum of a Err codemadness.org 70 i 9058 random field. Unfortunately, computing the distribution of the supremum of the Err codemadness.org 70 i 9059 random field is not easy and requires satisfying many distributional Err codemadness.org 70 i 9060 assumptions that may not be true in real data. Thus, there is a need to come up Err codemadness.org 70 i 9061 with a different framework that does not use the traditional statistical Err codemadness.org 70 i 9062 hypothesis testing paradigm that requires to compute p-values. With this as a Err codemadness.org 70 i 9063 motivation, we can use a different approach called the logistic regression that Err codemadness.org 70 i 9064 does not require computing the p-value and still be able to localize the Err codemadness.org 70 i 9065 regions of brain network differences. Unlike other discriminant and Err codemadness.org 70 i 9066 classification techniques that tried to classify preselected feature vectors, Err codemadness.org 70 i 9067 the method here does not require any preselected feature vectors and performs Err codemadness.org 70 i 9068 the classification at each edge level. Err codemadness.org 70 i 9069

Err codemadness.org 70 i 9070

Individuation and Adaptation in Complex Systems. (arXiv:2009.00110v2 [cs.NE] UPDATED)

Complex systems have certain characteristics such as network structures of a Err codemadness.org 70 i 9077 large number of individual elements, adaptation, and emergence. While these Err codemadness.org 70 i 9078 characteristics have been studied and described, it is often not so clear where Err codemadness.org 70 i 9079 they exactly come from. There is a focus on concrete system states rather than Err codemadness.org 70 i 9080 the emergence of the computer models themselves used to study these systems. To Err codemadness.org 70 i 9081 better understand typical characteristics of complex systems and their Err codemadness.org 70 i 9082 emergence, we recently presented a system metamodel based on which computer Err codemadness.org 70 i 9083 models can be created from abstract building blocks. In this study we extend Err codemadness.org 70 i 9084 our system metamodel with the concept of adaption in order to integrate Err codemadness.org 70 i 9085 adaptive computation in our so-called allagmatic method - a framework Err codemadness.org 70 i 9086 consisting of the system metamodel but also a way to study the creation of the Err codemadness.org 70 i 9087 computer model itself. Running experiments with cellular automata and Err codemadness.org 70 i 9088 artificial neural networks, we find that the system metamodel integrates Err codemadness.org 70 i 9089 adaptation with an additional operation called adaptation function that Err codemadness.org 70 i 9090 operates on the update function, which encodes the system's dynamics. It allows Err codemadness.org 70 i 9091 the creation of adaptive computations by providing an abstract template for Err codemadness.org 70 i 9092 adaptation and guidance for implementation. Further, the object-oriented and Err codemadness.org 70 i 9093 template meta-programming leads to a creation of computer models comparable to Err codemadness.org 70 i 9094 the individuation of observed systems. It therefore allows to study not only Err codemadness.org 70 i 9095 the behaviour of a running model but also its creation. The development of the Err codemadness.org 70 i 9096 system metamodel was first inspired by concepts of the philosophy of Err codemadness.org 70 i 9097 individuation of Gilbert Simondon. The theoretical background for the concept Err codemadness.org 70 i 9098 of adaptation is taken from the philosophy of organism of Alfred North Err codemadness.org 70 i 9099 Whitehead. In general, through the possibility to follow individuation, the Err codemadness.org 70 i 9100 allagmatic method allows to better understand the emergence of typical Err codemadness.org 70 i 9101 characteristics of complex systems. Err codemadness.org 70 i 9102

Err codemadness.org 70 i 9103

Distance Encoding: Design Provably More Powerful Neural Networks for Graph Representation Learning. (arXiv:2009.00142v4 [cs.LG] UPDATED)

Learning representations of sets of nodes in a graph is crucial for Err codemadness.org 70 i 9110 applications ranging from node-role discovery to link prediction and molecule Err codemadness.org 70 i 9111 classification. Graph Neural Networks (GNNs) have achieved great success in Err codemadness.org 70 i 9112 graph representation learning. However, expressive power of GNNs is limited by Err codemadness.org 70 i 9113 the 1-Weisfeiler-Lehman (WL) test and thus GNNs generate identical Err codemadness.org 70 i 9114 representations for graph substructures that may in fact be very different. Err codemadness.org 70 i 9115 More powerful GNNs, proposed recently by mimicking higher-order-WL tests, only Err codemadness.org 70 i 9116 focus on representing entire graphs and they are computationally inefficient as Err codemadness.org 70 i 9117 they cannot utilize sparsity of the underlying graph. Here we propose and Err codemadness.org 70 i 9118 mathematically analyze a general class of structure-related features, termed Err codemadness.org 70 i 9119 Distance Encoding (DE). DE assists GNNs in representing any set of nodes, while Err codemadness.org 70 i 9120 providing strictly more expressive power than the 1-WL test. DE captures the Err codemadness.org 70 i 9121 distance between the node set whose representation is to be learned and each Err codemadness.org 70 i 9122 node in the graph. To capture the distance DE can apply various graph-distance Err codemadness.org 70 i 9123 measures such as shortest path distance or generalized PageRank scores. We Err codemadness.org 70 i 9124 propose two ways for GNNs to use DEs (1) as extra node features, and (2) as Err codemadness.org 70 i 9125 controllers of message aggregation in GNNs. Both approaches can utilize the Err codemadness.org 70 i 9126 sparse structure of the underlying graph, which leads to computational Err codemadness.org 70 i 9127 efficiency and scalability. We also prove that DE can distinguish node sets Err codemadness.org 70 i 9128 embedded in almost all regular graphs where traditional GNNs always fail. We Err codemadness.org 70 i 9129 evaluate DE on three tasks over six real networks: structural role prediction, Err codemadness.org 70 i 9130 link prediction, and triangle prediction. Results show that our models Err codemadness.org 70 i 9131 outperform GNNs without DE by up-to 15\% in accuracy and AUROC. Furthermore, Err codemadness.org 70 i 9132 our models also significantly outperform other state-of-the-art methods Err codemadness.org 70 i 9133 especially designed for the above tasks. Err codemadness.org 70 i 9134

Err codemadness.org 70 i 9135

Accelerated reactive transport simulations in heterogeneous porous media using Reaktoro and Firedrake. (arXiv:2009.01194v2 [cs.CE] UPDATED)

This work investigates the performance of the on-demand machine learning Err codemadness.org 70 i 9142 (ODML) algorithm introduced in Leal et al. (2020) when applied to different Err codemadness.org 70 i 9143 reactive transport problems in heterogeneous porous media. ODML was devised to Err codemadness.org 70 i 9144 accelerate the computationally expensive geochemical reaction calculations in Err codemadness.org 70 i 9145 reactive transport simulations. We demonstrate that the ODML algorithm speeds Err codemadness.org 70 i 9146 up these calculations by one to three orders of magnitude. Such acceleration, Err codemadness.org 70 i 9147 in turn, significantly accelerates the entire reactive transport simulation. Err codemadness.org 70 i 9148 The numerical experiments are performed by implementing the coupling of two Err codemadness.org 70 i 9149 open-source software packages: Reaktoro (Leal, 2015) and Firedrake (Rathgeber Err codemadness.org 70 i 9150 et al., 2016). Err codemadness.org 70 i 9151

Err codemadness.org 70 i 9152

Analysis of Uplink IRS-Assisted NOMA under Nakagami-m Fading via Moments Matching. (arXiv:2009.03133v2 [cs.IT] UPDATED)

This letter investigates the uplink outage performance of intelligent Err codemadness.org 70 i 9159 reflecting surface (IRS)-assisted non-orthogonal multiple access (NOMA). We Err codemadness.org 70 i 9160 consider the general case where all users have both direct and reflection Err codemadness.org 70 i 9161 links, and all links undergo Nakagami-m fading. We approximate the received Err codemadness.org 70 i 9162 powers of the NOMA users as Gamma random variables via moments matching. This Err codemadness.org 70 i 9163 allows for tractable expressions of the outage under interference cancellation Err codemadness.org 70 i 9164 (IC), while being flexible in modeling various propagation environments. Our Err codemadness.org 70 i 9165 analysis shows that under certain conditions, the presence of an IRS might Err codemadness.org 70 i 9166 degrade the performance of users that have dominant line-of-sight (LOS) to the Err codemadness.org 70 i 9167 base station (BS), while users dominated by non-line-of-sight (NLOS) will Err codemadness.org 70 i 9168 always benefit from it. Err codemadness.org 70 i 9169

Err codemadness.org 70 i 9170

Physically Embedded Planning Problems: New Challenges for Reinforcement Learning. (arXiv:2009.05524v2 [cs.AI] UPDATED)

Recent work in deep reinforcement learning (RL) has produced algorithms Err codemadness.org 70 i 9177 capable of mastering challenging games such as Go, chess, or shogi. In these Err codemadness.org 70 i 9178 works the RL agent directly observes the natural state of the game and controls Err codemadness.org 70 i 9179 that state directly with its actions. However, when humans play such games, Err codemadness.org 70 i 9180 they do not just reason about the moves but also interact with their physical Err codemadness.org 70 i 9181 environment. They understand the state of the game by looking at the physical Err codemadness.org 70 i 9182 board in front of them and modify it by manipulating pieces using touch and Err codemadness.org 70 i 9183 fine-grained motor control. Mastering complicated physical systems with Err codemadness.org 70 i 9184 abstract goals is a central challenge for artificial intelligence, but it Err codemadness.org 70 i 9185 remains out of reach for existing RL algorithms. To encourage progress towards Err codemadness.org 70 i 9186 this goal we introduce a set of physically embedded planning problems and make Err codemadness.org 70 i 9187 them publicly available. We embed challenging symbolic tasks (Sokoban, Err codemadness.org 70 i 9188 tic-tac-toe, and Go) in a physics engine to produce a set of tasks that require Err codemadness.org 70 i 9189 perception, reasoning, and motor control over long time horizons. Although Err codemadness.org 70 i 9190 existing RL algorithms can tackle the symbolic versions of these tasks, we find Err codemadness.org 70 i 9191 that they struggle to master even the simplest of their physically embedded Err codemadness.org 70 i 9192 counterparts. As a first step towards characterizing the space of solution to Err codemadness.org 70 i 9193 these tasks, we introduce a strong baseline that uses a pre-trained expert game Err codemadness.org 70 i 9194 player to provide hints in the abstract space to an RL agent's policy while Err codemadness.org 70 i 9195 training it on the full sensorimotor control task. The resulting agent solves Err codemadness.org 70 i 9196 many of the tasks, underlining the need for methods that bridge the gap between Err codemadness.org 70 i 9197 abstract planning and embodied control. See illustrating video at Err codemadness.org 70 i 9198 https://youtu.be/RwHiHlym_1k. Err codemadness.org 70 i 9199

Err codemadness.org 70 i 9200

Beyond Individualized Recourse: Interpretable and Interactive Summaries of Actionable Recourses. (arXiv:2009.07165v3 [cs.LG] UPDATED)

As predictive models are increasingly being deployed in high-stakes Err codemadness.org 70 i 9207 decision-making, there has been a lot of interest in developing algorithms Err codemadness.org 70 i 9208 which can provide recourses to affected individuals. While developing such Err codemadness.org 70 i 9209 tools is important, it is even more critical to analyse and interpret a Err codemadness.org 70 i 9210 predictive model, and vet it thoroughly to ensure that the recourses it offers Err codemadness.org 70 i 9211 are meaningful and non-discriminatory before it is deployed in the real world. Err codemadness.org 70 i 9212 To this end, we propose a novel model agnostic framework called Actionable Err codemadness.org 70 i 9213 Recourse Summaries (AReS) to construct global counterfactual explanations which Err codemadness.org 70 i 9214 provide an interpretable and accurate summary of recourses for the entire Err codemadness.org 70 i 9215 population. We formulate a novel objective which simultaneously optimizes for Err codemadness.org 70 i 9216 correctness of the recourses and interpretability of the explanations, while Err codemadness.org 70 i 9217 minimizing overall recourse costs across the entire population. More Err codemadness.org 70 i 9218 specifically, our objective enables us to learn, with optimality guarantees on Err codemadness.org 70 i 9219 recourse correctness, a small number of compact rule sets each of which capture Err codemadness.org 70 i 9220 recourses for well defined subpopulations within the data. We also demonstrate Err codemadness.org 70 i 9221 theoretically that several of the prior approaches proposed to generate Err codemadness.org 70 i 9222 recourses for individuals are special cases of our framework. Experimental Err codemadness.org 70 i 9223 evaluation with real world datasets and user studies demonstrate that our Err codemadness.org 70 i 9224 framework can provide decision makers with a comprehensive overview of Err codemadness.org 70 i 9225 recourses corresponding to any black box model, and consequently help detect Err codemadness.org 70 i 9226 undesirable model biases and discrimination. Err codemadness.org 70 i 9227

Err codemadness.org 70 i 9228

CorDEL: A Contrastive Deep Learning Approach for Entity Linkage. (arXiv:2009.07203v2 [cs.DB] UPDATED)

Entity linkage (EL) is a critical problem in data cleaning and integration. Err codemadness.org 70 i 9235 In the past several decades, EL has typically been done by rule-based systems Err codemadness.org 70 i 9236 or traditional machine learning models with hand-curated features, both of Err codemadness.org 70 i 9237 which heavily depend on manual human inputs. With the ever-increasing growth of Err codemadness.org 70 i 9238 new data, deep learning (DL) based approaches have been proposed to alleviate Err codemadness.org 70 i 9239 the high cost of EL associated with the traditional models. Existing Err codemadness.org 70 i 9240 exploration of DL models for EL strictly follows the well-known twin-network Err codemadness.org 70 i 9241 architecture. However, we argue that the twin-network architecture is Err codemadness.org 70 i 9242 sub-optimal to EL, leading to inherent drawbacks of existing models. In order Err codemadness.org 70 i 9243 to address the drawbacks, we propose a novel and generic contrastive DL Err codemadness.org 70 i 9244 framework for EL. The proposed framework is able to capture both syntactic and Err codemadness.org 70 i 9245 semantic matching signals and pays attention to subtle but critical Err codemadness.org 70 i 9246 differences. Based on the framework, we develop a contrastive DL approach for Err codemadness.org 70 i 9247 EL, called CorDEL, with three powerful variants. We evaluate CorDEL with Err codemadness.org 70 i 9248 extensive experiments conducted on both public benchmark datasets and a Err codemadness.org 70 i 9249 real-world dataset. CorDEL outperforms previous state-of-the-art models by 5.2% Err codemadness.org 70 i 9250 on public benchmark datasets. Moreover, CorDEL yields a 2.4% improvement over Err codemadness.org 70 i 9251 the current best DL model on the real-world dataset, while reducing the number Err codemadness.org 70 i 9252 of training parameters by 97.6%. Err codemadness.org 70 i 9253

Err codemadness.org 70 i 9254

Autoregressive Knowledge Distillation through Imitation Learning. (arXiv:2009.07253v2 [cs.CL] UPDATED)

The performance of autoregressive models on natural language generation tasks Err codemadness.org 70 i 9261 has dramatically improved due to the adoption of deep, self-attentive Err codemadness.org 70 i 9262 architectures. However, these gains have come at the cost of hindering Err codemadness.org 70 i 9263 inference speed, making state-of-the-art models cumbersome to deploy in Err codemadness.org 70 i 9264 real-world, time-sensitive settings. We develop a compression technique for Err codemadness.org 70 i 9265 autoregressive models that is driven by an imitation learning perspective on Err codemadness.org 70 i 9266 knowledge distillation. The algorithm is designed to address the exposure bias Err codemadness.org 70 i 9267 problem. On prototypical language generation tasks such as translation and Err codemadness.org 70 i 9268 summarization, our method consistently outperforms other distillation Err codemadness.org 70 i 9269 algorithms, such as sequence-level knowledge distillation. Student models Err codemadness.org 70 i 9270 trained with our method attain 1.4 to 4.8 BLEU/ROUGE points higher than those Err codemadness.org 70 i 9271 trained from scratch, while increasing inference speed by up to 14 times in Err codemadness.org 70 i 9272 comparison to the teacher model. Err codemadness.org 70 i 9273

Err codemadness.org 70 i 9274

Video based real-time positional tracker. (arXiv:2009.08276v3 [cs.CV] UPDATED)

We propose a system that uses video as the input to track the position of Err codemadness.org 70 i 9281 objects relative to their surrounding environment in real-time. The neural Err codemadness.org 70 i 9282 network employed is trained on a 100% synthetic dataset coming from our own Err codemadness.org 70 i 9283 automated generator. The positional tracker relies on a range of 1 to n video Err codemadness.org 70 i 9284 cameras placed around an arena of choice. Err codemadness.org 70 i 9285

Err codemadness.org 70 i 9286

The system returns the positions of the tracked objects relative to the Err codemadness.org 70 i 9287 broader world by understanding the overlapping matrices formed by the cameras Err codemadness.org 70 i 9288 and therefore these can be extrapolated into real world coordinates. Err codemadness.org 70 i 9289

Err codemadness.org 70 i 9290

In most cases, we achieve a higher update rate and positioning precision than Err codemadness.org 70 i 9291 any of the existing GPS-based systems, in particular for indoor objects or Err codemadness.org 70 i 9292 those occluded from clear sky. Err codemadness.org 70 i 9293

Err codemadness.org 70 i 9294

An Embedded Index Code Construction Using Sub-packetization. (arXiv:2009.11329v2 [cs.IT] UPDATED)

A variant of the index coding problem (ICP), the embedded index coding Err codemadness.org 70 i 9301 problem (EICP) was introduced in [A. Porter and M. Wootters, "Embedded index Err codemadness.org 70 i 9302 coding," ITW, Sweden, 2019] which was motivated by its application in Err codemadness.org 70 i 9303 distributed computing where every user can act as sender for other users and an Err codemadness.org 70 i 9304 algorithm for code construction was reported. The constructions depends on the Err codemadness.org 70 i 9305 computation of minrank of a matrix, which is computationally intensive. In [A. Err codemadness.org 70 i 9306 Mahesh, N. Sageer Karat and B. S. Rajan, "Min-rank of Embedded Index Coding Err codemadness.org 70 i 9307 Problems," ISIT, 2020], for EICP, a notion of side-information matrix was Err codemadness.org 70 i 9308 introduced and it was proved that the length of an optimal scalar linear index Err codemadness.org 70 i 9309 code is equal to the min-rank of the side-information matrix. The authors have Err codemadness.org 70 i 9310 provided an explicit code construction for a class of EICP - Err codemadness.org 70 i 9311 \textit{Consecutive and Symmetric Embedded Index Coding Problem (CS-EICP)}. We Err codemadness.org 70 i 9312 introduce the idea of sub-packetization of the messages in index coding Err codemadness.org 70 i 9313 problems to provide a novel code construction for CS-EICP in contrast to the Err codemadness.org 70 i 9314 scalar linear solutions provided in the prior works. For CS-EICP, the Err codemadness.org 70 i 9315 normalized rate, which is defined as the number of bits transmitted by all the Err codemadness.org 70 i 9316 users together normalized by the total number of bits of all the messages, for Err codemadness.org 70 i 9317 our construction is lesser than the normalized rate achieved by Mahesh et Err codemadness.org 70 i 9318 al.,for scalar linear codes. Err codemadness.org 70 i 9319

Err codemadness.org 70 i 9320

Multi-scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex Domains. (arXiv:2009.12729v2 [math.NA] UPDATED)

In this paper, we study a multi-scale deep neural network (MscaleDNN) as a Err codemadness.org 70 i 9327 meshless numerical method for computing oscillatory Stokes flows in complex Err codemadness.org 70 i 9328 domains. The MscaleDNN employs a multi-scale structure in the design of its DNN Err codemadness.org 70 i 9329 using radial scalings to convert the approximation of high frequency components Err codemadness.org 70 i 9330 of the highly oscillatory Stokes solution to one of lower frequencies. The Err codemadness.org 70 i 9331 MscaleDNN solution to the Stokes problem is obtained by minimizing a loss Err codemadness.org 70 i 9332 function in terms of L2 normof the residual of the Stokes equation. Three forms Err codemadness.org 70 i 9333 of loss functions are investigated based on vorticity-velocity-pressure, Err codemadness.org 70 i 9334 velocity-stress-pressure, and velocity-gradient of velocity-pressure Err codemadness.org 70 i 9335 formulations of the Stokes equation. We first conduct a systematic study of the Err codemadness.org 70 i 9336 MscaleDNN methods with various loss functions on the Kovasznay flow in Err codemadness.org 70 i 9337 comparison with normal fully connected DNNs. Then, Stokes flows with highly Err codemadness.org 70 i 9338 oscillatory solutions in a 2-D domain with six randomly placed holes are Err codemadness.org 70 i 9339 simulated by the MscaleDNN. The results show that MscaleDNN has faster Err codemadness.org 70 i 9340 convergence and consistent error decays in the simulation of Kovasznay flow for Err codemadness.org 70 i 9341 all four tested loss functions. More importantly, the MscaleDNN is capable of Err codemadness.org 70 i 9342 learning highly oscillatory solutions when the normal DNNs fail to converge. Err codemadness.org 70 i 9343

Err codemadness.org 70 i 9344

Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization. (arXiv:2009.12829v3 [cs.CV] UPDATED)

Recently, we have witnessed great progress in the field of medical imaging Err codemadness.org 70 i 9351 classification by adopting deep neural networks. However, the recent advanced Err codemadness.org 70 i 9352 models still require accessing sufficiently large and representative datasets Err codemadness.org 70 i 9353 for training, which is often unfeasible in clinically realistic environments. Err codemadness.org 70 i 9354 When trained on limited datasets, the deep neural network is lack of Err codemadness.org 70 i 9355 generalization capability, as the trained deep neural network on data within a Err codemadness.org 70 i 9356 certain distribution (e.g. the data captured by a certain device vendor or Err codemadness.org 70 i 9357 patient population) may not be able to generalize to the data with another Err codemadness.org 70 i 9358 distribution. Err codemadness.org 70 i 9359

Err codemadness.org 70 i 9360

In this paper, we introduce a simple but effective approach to improve the Err codemadness.org 70 i 9361 generalization capability of deep neural networks in the field of medical Err codemadness.org 70 i 9362 imaging classification. Motivated by the observation that the domain Err codemadness.org 70 i 9363 variability of the medical images is to some extent compact, we propose to Err codemadness.org 70 i 9364 learn a representative feature space through variational encoding with a novel Err codemadness.org 70 i 9365 linear-dependency regularization term to capture the shareable information Err codemadness.org 70 i 9366 among medical data collected from different domains. As a result, the trained Err codemadness.org 70 i 9367 neural network is expected to equip with better generalization capability to Err codemadness.org 70 i 9368 the "unseen" medical data. Experimental results on two challenging medical Err codemadness.org 70 i 9369 imaging classification tasks indicate that our method can achieve better Err codemadness.org 70 i 9370 cross-domain generalization capability compared with state-of-the-art Err codemadness.org 70 i 9371 baselines. Err codemadness.org 70 i 9372

Err codemadness.org 70 i 9373

Dual Attention Model for Citation Recommendation. (arXiv:2010.00182v4 [cs.IR] UPDATED)

Based on an exponentially increasing number of academic articles, discovering Err codemadness.org 70 i 9380 and citing comprehensive and appropriate resources has become a non-trivial Err codemadness.org 70 i 9381 task. Conventional citation recommender methods suffer from severe information Err codemadness.org 70 i 9382 loss. For example, they do not consider the section of the paper that the user Err codemadness.org 70 i 9383 is writing and for which they need to find a citation, the relatedness between Err codemadness.org 70 i 9384 the words in the local context (the text span that describes a citation), or Err codemadness.org 70 i 9385 the importance on each word from the local context. These shortcomings make Err codemadness.org 70 i 9386 such methods insufficient for recommending adequate citations to academic Err codemadness.org 70 i 9387 manuscripts. In this study, we propose a novel embedding-based neural network Err codemadness.org 70 i 9388 called "dual attention model for citation recommendation (DACR)" to recommend Err codemadness.org 70 i 9389 citations during manuscript preparation. Our method adapts embedding of three Err codemadness.org 70 i 9390 dimensions of semantic information: words in the local context, structural Err codemadness.org 70 i 9391 contexts, and the section on which a user is working. A neural network is Err codemadness.org 70 i 9392 designed to maximize the similarity between the embedding of the three input Err codemadness.org 70 i 9393 (local context words, section and structural contexts) and the target citation Err codemadness.org 70 i 9394 appearing in the context. The core of the neural network is composed of Err codemadness.org 70 i 9395 self-attention and additive attention, where the former aims to capture the Err codemadness.org 70 i 9396 relatedness between the contextual words and structural context, and the latter Err codemadness.org 70 i 9397 aims to learn the importance of them. The experiments on real-world datasets Err codemadness.org 70 i 9398 demonstrate the effectiveness of the proposed approach. Err codemadness.org 70 i 9399

Err codemadness.org 70 i 9400

Pretrained Language Model Embryology: The Birth of ALBERT. (arXiv:2010.02480v2 [cs.CL] UPDATED)

While behaviors of pretrained language models (LMs) have been thoroughly Err codemadness.org 70 i 9407 examined, what happened during pretraining is rarely studied. We thus Err codemadness.org 70 i 9408 investigate the developmental process from a set of randomly initialized Err codemadness.org 70 i 9409 parameters to a totipotent language model, which we refer to as the embryology Err codemadness.org 70 i 9410 of a pretrained language model. Our results show that ALBERT learns to Err codemadness.org 70 i 9411 reconstruct and predict tokens of different parts of speech (POS) in different Err codemadness.org 70 i 9412 learning speeds during pretraining. We also find that linguistic knowledge and Err codemadness.org 70 i 9413 world knowledge do not generally improve as pretraining proceeds, nor do Err codemadness.org 70 i 9414 downstream tasks' performance. These findings suggest that knowledge of a Err codemadness.org 70 i 9415 pretrained model varies during pretraining, and having more pretrain steps does Err codemadness.org 70 i 9416 not necessarily provide a model with more comprehensive knowledge. We will Err codemadness.org 70 i 9417 provide source codes and pretrained models to reproduce our results at Err codemadness.org 70 i 9418 https://github.com/d223302/albert-embryology. Err codemadness.org 70 i 9419

Err codemadness.org 70 i 9420

Investigating African-American Vernacular English in Transformer-Based Text Generation. (arXiv:2010.02510v2 [cs.CL] UPDATED)

The growth of social media has encouraged the written use of African American Err codemadness.org 70 i 9427 Vernacular English (AAVE), which has traditionally been used only in oral Err codemadness.org 70 i 9428 contexts. However, NLP models have historically been developed using dominant Err codemadness.org 70 i 9429 English varieties, such as Standard American English (SAE), due to text corpora Err codemadness.org 70 i 9430 availability. We investigate the performance of GPT-2 on AAVE text by creating Err codemadness.org 70 i 9431 a dataset of intent-equivalent parallel AAVE/SAE tweet pairs, thereby isolating Err codemadness.org 70 i 9432 syntactic structure and AAVE- or SAE-specific language for each pair. We Err codemadness.org 70 i 9433 evaluate each sample and its GPT-2 generated text with pretrained sentiment Err codemadness.org 70 i 9434 classifiers and find that while AAVE text results in more classifications of Err codemadness.org 70 i 9435 negative sentiment than SAE, the use of GPT-2 generally increases occurrences Err codemadness.org 70 i 9436 of positive sentiment for both. Additionally, we conduct human evaluation of Err codemadness.org 70 i 9437 AAVE and SAE text generated with GPT-2 to compare contextual rigor and overall Err codemadness.org 70 i 9438 quality. Err codemadness.org 70 i 9439

Err codemadness.org 70 i 9440

Improved Analysis of Clipping Algorithms for Non-convex Optimization. (arXiv:2010.02519v2 [cs.LG] UPDATED)

Gradient clipping is commonly used in training deep neural networks partly Err codemadness.org 70 i 9447 due to its practicability in relieving the exploding gradient problem. Err codemadness.org 70 i 9448 Recently, \citet{zhang2019gradient} show that clipped (stochastic) Gradient Err codemadness.org 70 i 9449 Descent (GD) converges faster than vanilla GD/SGD via introducing a new Err codemadness.org 70 i 9450 assumption called $(L_0, L_1)$-smoothness, which characterizes the violent Err codemadness.org 70 i 9451 fluctuation of gradients typically encountered in deep neural networks. Err codemadness.org 70 i 9452 However, their iteration complexities on the problem-dependent parameters are Err codemadness.org 70 i 9453 rather pessimistic, and theoretical justification of clipping combined with Err codemadness.org 70 i 9454 other crucial techniques, e.g. momentum acceleration, are still lacking. In Err codemadness.org 70 i 9455 this paper, we bridge the gap by presenting a general framework to study the Err codemadness.org 70 i 9456 clipping algorithms, which also takes momentum methods into consideration. We Err codemadness.org 70 i 9457 provide convergence analysis of the framework in both deterministic and Err codemadness.org 70 i 9458 stochastic setting, and demonstrate the tightness of our results by comparing Err codemadness.org 70 i 9459 them with existing lower bounds. Our results imply that the efficiency of Err codemadness.org 70 i 9460 clipping methods will not degenerate even in highly non-smooth regions of the Err codemadness.org 70 i 9461 landscape. Experiments confirm the superiority of clipping-based methods in Err codemadness.org 70 i 9462 deep learning tasks. Err codemadness.org 70 i 9463

Err codemadness.org 70 i 9464

Improving Local Identifiability in Probabilistic Box Embeddings. (arXiv:2010.04831v2 [cs.LG] UPDATED)

Geometric embeddings have recently received attention for their natural Err codemadness.org 70 i 9471 ability to represent transitive asymmetric relations via containment. Box Err codemadness.org 70 i 9472 embeddings, where objects are represented by n-dimensional hyperrectangles, are Err codemadness.org 70 i 9473 a particularly promising example of such an embedding as they are closed under Err codemadness.org 70 i 9474 intersection and their volume can be calculated easily, allowing them to Err codemadness.org 70 i 9475 naturally represent calibrated probability distributions. The benefits of Err codemadness.org 70 i 9476 geometric embeddings also introduce a problem of local identifiability, Err codemadness.org 70 i 9477 however, where whole neighborhoods of parameters result in equivalent loss Err codemadness.org 70 i 9478 which impedes learning. Prior work addressed some of these issues by using an Err codemadness.org 70 i 9479 approximation to Gaussian convolution over the box parameters, however, this Err codemadness.org 70 i 9480 intersection operation also increases the sparsity of the gradient. In this Err codemadness.org 70 i 9481 work, we model the box parameters with min and max Gumbel distributions, which Err codemadness.org 70 i 9482 were chosen such that space is still closed under the operation of the Err codemadness.org 70 i 9483 intersection. The calculation of the expected intersection volume involves all Err codemadness.org 70 i 9484 parameters, and we demonstrate experimentally that this drastically improves Err codemadness.org 70 i 9485 the ability of such models to learn. Err codemadness.org 70 i 9486

Err codemadness.org 70 i 9487

Neural-Symbolic Reasoning on Knowledge Graphs. (arXiv:2010.05446v3 [cs.AI] UPDATED)

Knowledge graph reasoning is the fundamental component to support machine Err codemadness.org 70 i 9494 learning applications such as information extraction, information retrieval and Err codemadness.org 70 i 9495 recommendation. Since knowledge graph can be viewed as the discrete symbolic Err codemadness.org 70 i 9496 representations of knowledge, reasoning on knowledge graphs can naturally Err codemadness.org 70 i 9497 leverage the symbolic techniques. However, symbolic reasoning is intolerant of Err codemadness.org 70 i 9498 the ambiguous and noisy data. On the contrary, the recent advances of deep Err codemadness.org 70 i 9499 learning promote neural reasoning on knowledge graphs, which is robust to the Err codemadness.org 70 i 9500 ambiguous and noisy data, but lacks interpretability compared to symbolic Err codemadness.org 70 i 9501 reasoning. Considering the advantages and disadvantages of both methodologies, Err codemadness.org 70 i 9502 recent efforts have been made on combining the two reasoning methods. In this Err codemadness.org 70 i 9503 survey, we take a thorough look at the development of the symbolic reasoning, Err codemadness.org 70 i 9504 neural reasoning and the neural-symbolic reasoning on knowledge graphs. We Err codemadness.org 70 i 9505 survey two specific reasoning tasks, knowledge graph completion and question Err codemadness.org 70 i 9506 answering on knowledge graphs, and explain them in a unified reasoning Err codemadness.org 70 i 9507 framework. We also briefly discuss the future directions for knowledge graph Err codemadness.org 70 i 9508 reasoning. Err codemadness.org 70 i 9509

Err codemadness.org 70 i 9510

On lattice point counting in $\Delta$-modular polyhedra. (arXiv:2010.05768v2 [cs.CC] UPDATED)

Let a polyhedron $P$ be defined by one of the following ways: Err codemadness.org 70 i 9517

Err codemadness.org 70 i 9518

(i) $P = \{x \in R^n \colon A x \leq b\}$, where $A \in Z^{(n+k) \times n}$, Err codemadness.org 70 i 9519 $b \in Z^{(n+k)}$ and $rank\, A = n$; Err codemadness.org 70 i 9520

Err codemadness.org 70 i 9521

(ii) $P = \{x \in R_+^n \colon A x = b\}$, where $A \in Z^{k \times n}$, $b Err codemadness.org 70 i 9522 \in Z^{k}$ and $rank\, A = k$. Err codemadness.org 70 i 9523

Err codemadness.org 70 i 9524

And let all rank order minors of $A$ be bounded by $\Delta$ in absolute Err codemadness.org 70 i 9525 values. We show that the short rational generating function for the power Err codemadness.org 70 i 9526 series $$ \sum\limits_{m \in P \cap Z^n} x^m $$ can be computed with the Err codemadness.org 70 i 9527 arithmetic complexity $ O\left(T_{SNF}(d) \cdot d^{k} \cdot d^{\log_2 Err codemadness.org 70 i 9528 \Delta}\right), $ where $k$ and $\Delta$ are fixed, $d = \dim P$, and Err codemadness.org 70 i 9529 $T_{SNF}(m)$ is the complexity to compute the Smith Normal Form for $m \times Err codemadness.org 70 i 9530 m$ integer matrix. In particular, $d = n$ for the case (i) and $d = n-k$ for Err codemadness.org 70 i 9531 the case (ii). Err codemadness.org 70 i 9532

Err codemadness.org 70 i 9533

The simplest examples of polyhedra that meet conditions (i) or (ii) are the Err codemadness.org 70 i 9534 simplicies, the subset sum polytope and the knapsack or multidimensional Err codemadness.org 70 i 9535 knapsack polytopes. Err codemadness.org 70 i 9536

Err codemadness.org 70 i 9537

We apply these results to parametric polytopes, and show that the step Err codemadness.org 70 i 9538 polynomial representation of the function $c_P(y) = |P_{y} \cap Z^n|$, where Err codemadness.org 70 i 9539 $P_{y}$ is parametric polytope, can be computed by a polynomial time even in Err codemadness.org 70 i 9540 varying dimension if $P_{y}$ has a close structure to the cases (i) or (ii). As Err codemadness.org 70 i 9541 another consequence, we show that the coefficients $e_i(P,m)$ of the Ehrhart Err codemadness.org 70 i 9542 quasi-polynomial $$ \left| mP \cap Z^n\right| = \sum\limits_{j = 0}^n Err codemadness.org 70 i 9543 e_i(P,m)m^j $$ can be computed by a polynomial time algorithm for fixed $k$ and Err codemadness.org 70 i 9544 $\Delta$. Err codemadness.org 70 i 9545

Err codemadness.org 70 i 9546

CAPT: Contrastive Pre-Training for Learning Denoised Sequence Representations. (arXiv:2010.06351v3 [cs.CL] UPDATED)

Pre-trained self-supervised models such as BERT have achieved striking Err codemadness.org 70 i 9553 success in learning sequence representations, especially for natural language Err codemadness.org 70 i 9554 processing. These models typically corrupt the given sequences with certain Err codemadness.org 70 i 9555 types of noise, such as masking, shuffling, or substitution, and then try to Err codemadness.org 70 i 9556 recover the original input. However, such pre-training approaches are prone to Err codemadness.org 70 i 9557 learning representations that are covariant with the noise, leading to the Err codemadness.org 70 i 9558 discrepancy between the pre-training and fine-tuning stage. To remedy this, we Err codemadness.org 70 i 9559 present ContrAstive Pre-Training (CAPT) to learn noise invariant sequence Err codemadness.org 70 i 9560 representations. The proposed CAPT encourages the consistency between Err codemadness.org 70 i 9561 representations of the original sequence and its corrupted version via Err codemadness.org 70 i 9562 unsupervised instance-wise training signals. In this way, it not only Err codemadness.org 70 i 9563 alleviates the pretrain-finetune discrepancy induced by the noise of Err codemadness.org 70 i 9564 pre-training, but also aids the pre-trained model in better capturing global Err codemadness.org 70 i 9565 semantics of the input via more effective sentence-level supervision. Different Err codemadness.org 70 i 9566 from most prior work that focuses on a particular modality, comprehensive Err codemadness.org 70 i 9567 empirical evidence on 11 natural language understanding and cross-modal tasks Err codemadness.org 70 i 9568 illustrates that CAPT is applicable for both language and vision-language Err codemadness.org 70 i 9569 tasks, and obtains surprisingly consistent improvement, including 0.6% absolute Err codemadness.org 70 i 9570 gain on GLUE benchmarks and 0.8% absolute increment on NLVR. Err codemadness.org 70 i 9571

Err codemadness.org 70 i 9572

Spherical Knowledge Distillation. (arXiv:2010.07485v2 [cs.LG] UPDATED)

Knowledge distillation aims at obtaining a small but effective deep model by Err codemadness.org 70 i 9579 transferring knowledge from a much larger one. The previous approaches try to Err codemadness.org 70 i 9580 reach this goal by simply "logit-supervised" information transferring between Err codemadness.org 70 i 9581 the teacher and student, which somehow can be subsequently decomposed as the Err codemadness.org 70 i 9582 transfer of normalized logits and $l^2$ norm. We argue that the norm of logits Err codemadness.org 70 i 9583 is actually interference, which damages the efficiency in the transfer process. Err codemadness.org 70 i 9584 To address this problem, we propose Spherical Knowledge Distillation (SKD). Err codemadness.org 70 i 9585 Specifically, we project the teacher and the student's logits into a unit Err codemadness.org 70 i 9586 sphere, and then we can efficiently perform knowledge distillation on the Err codemadness.org 70 i 9587 sphere. We verify our argument via theoretical analysis and ablation study. Err codemadness.org 70 i 9588 Extensive experiments have demonstrated the superiority and scalability of our Err codemadness.org 70 i 9589 method over the SOTAs. Err codemadness.org 70 i 9590

Err codemadness.org 70 i 9591

Measuring the Dynamic Impact of High-Speed Railways on Urban Interactions in China. (arXiv:2010.08182v3 [cs.SI] UPDATED)

High-speed rail (HSR) has become an important mode of inter-city Err codemadness.org 70 i 9598 transportation between large cities. Inter-city interaction facilitated by HSR Err codemadness.org 70 i 9599 tends to play a more prominent role in promoting urban and regional economic Err codemadness.org 70 i 9600 integration and development. Quantifying the impact of HSR's interaction on Err codemadness.org 70 i 9601 cities and people is therefore crucial for long-term urban and regional Err codemadness.org 70 i 9602 development planning and policy making. We develop an evaluation framework Err codemadness.org 70 i 9603 using toponym information from social media as a proxy to estimate the dynamics Err codemadness.org 70 i 9604 of such interactions. This paper adopts two types of spatial information: Err codemadness.org 70 i 9605 toponyms from social media posts, and the geographical location information Err codemadness.org 70 i 9606 embedded in social media posts. The framework highlights the asymmetric nature Err codemadness.org 70 i 9607 of social interaction among cities, and proposes a series of metrics to Err codemadness.org 70 i 9608 quantify such impact from multiple perspectives, including interaction Err codemadness.org 70 i 9609 strength, spatial decay, and channel effect. The results show that HSRs not Err codemadness.org 70 i 9610 only greatly expand the uneven distribution of inter-city connections, but also Err codemadness.org 70 i 9611 significantly reshape the interactions that occur along HSR routes through the Err codemadness.org 70 i 9612 channel effect. Err codemadness.org 70 i 9613

Err codemadness.org 70 i 9614

Learning Accurate Entropy Model with Global Reference for Image Compression. (arXiv:2010.08321v2 [eess.IV] UPDATED)

In recent deep image compression neural networks, the entropy model plays a Err codemadness.org 70 i 9621 critical role in estimating the prior distribution of deep image encodings. Err codemadness.org 70 i 9622 Existing methods combine hyperprior with local context in the entropy Err codemadness.org 70 i 9623 estimation function. This greatly limits their performance due to the absence Err codemadness.org 70 i 9624 of a global vision. In this work, we propose a novel Global Reference Model for Err codemadness.org 70 i 9625 image compression to effectively leverage both the local and the global context Err codemadness.org 70 i 9626 information, leading to an enhanced compression rate. The proposed method scans Err codemadness.org 70 i 9627 decoded latents and then finds the most relevant latent to assist the Err codemadness.org 70 i 9628 distribution estimating of the current latent. A by-product of this work is the Err codemadness.org 70 i 9629 innovation of a mean-shifting GDN module that further improves the performance. Err codemadness.org 70 i 9630 Experimental results demonstrate that the proposed model outperforms the Err codemadness.org 70 i 9631 rate-distortion performance of most of the state-of-the-art methods in the Err codemadness.org 70 i 9632 industry. Err codemadness.org 70 i 9633

Err codemadness.org 70 i 9634

A Grid-based Representation for Human Action Recognition. (arXiv:2010.08841v2 [cs.CV] UPDATED)

Human action recognition (HAR) in videos is a fundamental research topic in Err codemadness.org 70 i 9641 computer vision. It consists mainly in understanding actions performed by Err codemadness.org 70 i 9642 humans based on a sequence of visual observations. In recent years, HAR have Err codemadness.org 70 i 9643 witnessed significant progress, especially with the emergence of deep learning Err codemadness.org 70 i 9644 models. However, most of existing approaches for action recognition rely on Err codemadness.org 70 i 9645 information that is not always relevant for this task, and are limited in the Err codemadness.org 70 i 9646 way they fuse the temporal information. In this paper, we propose a novel Err codemadness.org 70 i 9647 method for human action recognition that encodes efficiently the most Err codemadness.org 70 i 9648 discriminative appearance information of an action with explicit attention on Err codemadness.org 70 i 9649 representative pose features, into a new compact grid representation. Our GRAR Err codemadness.org 70 i 9650 (Grid-based Representation for Action Recognition) method is tested on several Err codemadness.org 70 i 9651 benchmark datasets demonstrating that our model can accurately recognize human Err codemadness.org 70 i 9652 actions, despite intra-class appearance variations and occlusion challenges. Err codemadness.org 70 i 9653

Err codemadness.org 70 i 9654

What breach? Measuring online awareness of security incidents by studying real-world browsing behavior. (arXiv:2010.09843v2 [cs.CR] UPDATED)

Awareness about security and privacy risks is important for developing good Err codemadness.org 70 i 9661 security habits. Learning about real-world security incidents and data breaches Err codemadness.org 70 i 9662 can alert people to the ways in which their information is vulnerable online, Err codemadness.org 70 i 9663 thus playing a significant role in encouraging safe security behavior. This Err codemadness.org 70 i 9664 paper examines 1) how often people read about security incidents online, 2) of Err codemadness.org 70 i 9665 those people, whether and to what extent they follow up with an action, e.g., Err codemadness.org 70 i 9666 by trying to read more about the incident, and 3) what influences the Err codemadness.org 70 i 9667 likelihood that they will read about an incident and take some action. We study Err codemadness.org 70 i 9668 this by quantitatively examining real-world internet-browsing data from 303 Err codemadness.org 70 i 9669 participants. Err codemadness.org 70 i 9670

Err codemadness.org 70 i 9671

Our findings present a bleak view of awareness of security incidents. Only Err codemadness.org 70 i 9672 17% of participants visited any web pages related to six widely publicized Err codemadness.org 70 i 9673 large-scale security incidents; few read about one even when an incident was Err codemadness.org 70 i 9674 likely to have affected them (e.g., the Equifax breach almost universally Err codemadness.org 70 i 9675 affected people with Equifax credit reports). We further found that more severe Err codemadness.org 70 i 9676 incidents as well as articles that constructively spoke about the incident Err codemadness.org 70 i 9677 inspired more action. We conclude with recommendations for specific future Err codemadness.org 70 i 9678 research and for enabling useful security incident information to reach more Err codemadness.org 70 i 9679 people. Err codemadness.org 70 i 9680

Err codemadness.org 70 i 9681

VarGrad: A Low-Variance Gradient Estimator for Variational Inference. (arXiv:2010.10436v2 [stat.ML] UPDATED)

We analyse the properties of an unbiased gradient estimator of the ELBO for Err codemadness.org 70 i 9688 variational inference, based on the score function method with leave-one-out Err codemadness.org 70 i 9689 control variates. We show that this gradient estimator can be obtained using a Err codemadness.org 70 i 9690 new loss, defined as the variance of the log-ratio between the exact posterior Err codemadness.org 70 i 9691 and the variational approximation, which we call the $\textit{log-variance Err codemadness.org 70 i 9692 loss}$. Under certain conditions, the gradient of the log-variance loss equals Err codemadness.org 70 i 9693 the gradient of the (negative) ELBO. We show theoretically that this gradient Err codemadness.org 70 i 9694 estimator, which we call $\textit{VarGrad}$ due to its connection to the Err codemadness.org 70 i 9695 log-variance loss, exhibits lower variance than the score function method in Err codemadness.org 70 i 9696 certain settings, and that the leave-one-out control variate coefficients are Err codemadness.org 70 i 9697 close to the optimal ones. We empirically demonstrate that VarGrad offers a Err codemadness.org 70 i 9698 favourable variance versus computation trade-off compared to other Err codemadness.org 70 i 9699 state-of-the-art estimators on a discrete VAE. Err codemadness.org 70 i 9700

Err codemadness.org 70 i 9701

A Coarse-To-Fine (C2F) Representation for End-To-End 6-DoF Grasp Detection. (arXiv:2010.10695v2 [cs.RO] UPDATED)

We proposed an end-to-end grasp detection network, Grasp Detection Network Err codemadness.org 70 i 9708 (GDN), cooperated with a novel coarse-to-fine (C2F) grasp representation design Err codemadness.org 70 i 9709 to detect diverse and accurate 6-DoF grasps based on point clouds. Compared to Err codemadness.org 70 i 9710 previous two-stage approaches which sample and evaluate multiple grasp Err codemadness.org 70 i 9711 candidates, our architecture is at least 20 times faster. It is also 8% and 40% Err codemadness.org 70 i 9712 more accurate in terms of the success rate in single object scenes and the Err codemadness.org 70 i 9713 complete rate in clutter scenes, respectively. Our method shows superior Err codemadness.org 70 i 9714 results among settings with different number of views and input points. Err codemadness.org 70 i 9715 Moreover, we propose a new AP-based metric which considers both rotation and Err codemadness.org 70 i 9716 transition errors, making it a more comprehensive evaluation tool for grasp Err codemadness.org 70 i 9717 detection models. Err codemadness.org 70 i 9718

Err codemadness.org 70 i 9719

Model selection in reconciling hierarchical time series. (arXiv:2010.10742v2 [cs.LG] UPDATED)

Model selection has been proven an effective strategy for improving accuracy Err codemadness.org 70 i 9726 in time series forecasting applications. However, when dealing with Err codemadness.org 70 i 9727 hierarchical time series, apart from selecting the most appropriate forecasting Err codemadness.org 70 i 9728 model, forecasters have also to select a suitable method for reconciling the Err codemadness.org 70 i 9729 base forecasts produced for each series to make sure they are coherent. Err codemadness.org 70 i 9730 Although some hierarchical forecasting methods like minimum trace are strongly Err codemadness.org 70 i 9731 supported both theoretically and empirically for reconciling the base Err codemadness.org 70 i 9732 forecasts, there are still circumstances under which they might not produce the Err codemadness.org 70 i 9733 most accurate results, being outperformed by other methods. In this paper we Err codemadness.org 70 i 9734 propose an approach for dynamically selecting the most appropriate hierarchical Err codemadness.org 70 i 9735 forecasting method and succeeding better forecasting accuracy along with Err codemadness.org 70 i 9736 coherence. The approach, to be called conditional hierarchical forecasting, is Err codemadness.org 70 i 9737 based on Machine Learning classification methods and uses time series features Err codemadness.org 70 i 9738 as leading indicators for performing the selection for each hierarchy examined Err codemadness.org 70 i 9739 considering a variety of alternatives. Our results suggest that conditional Err codemadness.org 70 i 9740 hierarchical forecasting leads to significantly more accurate forecasts than Err codemadness.org 70 i 9741 standard approaches, especially at lower hierarchical levels. Err codemadness.org 70 i 9742

Err codemadness.org 70 i 9743

Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognition. (arXiv:2010.10759v3 [cs.SD] UPDATED)

This paper proposes an efficient memory transformer Emformer for low latency Err codemadness.org 70 i 9750 streaming speech recognition. In Emformer, the long-range history context is Err codemadness.org 70 i 9751 distilled into an augmented memory bank to reduce self-attention's computation Err codemadness.org 70 i 9752 complexity. A cache mechanism saves the computation for the key and value in Err codemadness.org 70 i 9753 self-attention for the left context. Emformer applies a parallelized block Err codemadness.org 70 i 9754 processing in training to support low latency models. We carry out experiments Err codemadness.org 70 i 9755 on benchmark LibriSpeech data. Under average latency of 960 ms, Emformer gets Err codemadness.org 70 i 9756 WER $2.50\%$ on test-clean and $5.62\%$ on test-other. Comparing with a strong Err codemadness.org 70 i 9757 baseline augmented memory transformer (AM-TRF), Emformer gets $4.6$ folds Err codemadness.org 70 i 9758 training speedup and $18\%$ relative real-time factor (RTF) reduction in Err codemadness.org 70 i 9759 decoding with relative WER reduction $17\%$ on test-clean and $9\%$ on Err codemadness.org 70 i 9760 test-other. For a low latency scenario with an average latency of 80 ms, Err codemadness.org 70 i 9761 Emformer achieves WER $3.01\%$ on test-clean and $7.09\%$ on test-other. Err codemadness.org 70 i 9762 Comparing with the LSTM baseline with the same latency and model size, Emformer Err codemadness.org 70 i 9763 gets relative WER reduction $9\%$ and $16\%$ on test-clean and test-other, Err codemadness.org 70 i 9764 respectively. Err codemadness.org 70 i 9765

Err codemadness.org 70 i 9766

Large-Scale High PV Power Grid Dynamic Model Development -- A Case Study on the U.S. Eastern Interconnection. (arXiv:2010.11150v2 [eess.SY] UPDATED)

Power systems are undergoing a transformation toward a low-carbon Err codemadness.org 70 i 9773 non-synchronous generation portfolio. A major concern for system planners and Err codemadness.org 70 i 9774 operators is the system dynamics in the high renewable penetration future. Err codemadness.org 70 i 9775 Because of the scale of the system and numerous components involved, it is Err codemadness.org 70 i 9776 extremely difficult to develop high PV dynamic models based upon actual power Err codemadness.org 70 i 9777 system models. The main contribution of this paper is providing an example of Err codemadness.org 70 i 9778 developing high PV penetration models based on the validated dynamic model of Err codemadness.org 70 i 9779 an actual large-scale power grid - the U.S. Eastern Interconnection system. The Err codemadness.org 70 i 9780 displacement of conventional generators by PV is realized by optimization. Err codemadness.org 70 i 9781 Combining the PV distribution optimization and the validated dynamic model Err codemadness.org 70 i 9782 information, this approach avoids the uncertainties brought about by Err codemadness.org 70 i 9783 transmission planning. As the existing dynamic models can be validated by Err codemadness.org 70 i 9784 measurements, this approach improves the credibility of the high PV models in Err codemadness.org 70 i 9785 representing future power grids. This generic approach can be applied to Err codemadness.org 70 i 9786 develop high PV dynamic models for other actual large-scale systems. Err codemadness.org 70 i 9787

Err codemadness.org 70 i 9788

Build Smart Grids on Artificial Intelligence -- A Real-world Example. (arXiv:2010.11175v2 [eess.SY] UPDATED)

Power grid data are going big with the deployment of various sensors. The big Err codemadness.org 70 i 9795 data in power grids creates huge opportunities for applying artificial Err codemadness.org 70 i 9796 intelligence technologies to improve resilience and reliability. This paper Err codemadness.org 70 i 9797 introduces multiple real-world applications based on artificial intelligence to Err codemadness.org 70 i 9798 improve power grid situational awareness and resilience. These applications Err codemadness.org 70 i 9799 include event identification, inertia estimation, event location and magnitude Err codemadness.org 70 i 9800 estimation, data authentication, control, and stability assessment. These Err codemadness.org 70 i 9801 applications are operating on a real-world system called FNET-GridEye, which is Err codemadness.org 70 i 9802 a wide-area measurement network and arguably the world-largest cyber-physical Err codemadness.org 70 i 9803 system that collects power grid big data. These applications showed much better Err codemadness.org 70 i 9804 performance compared with conventional approaches and accomplished new tasks Err codemadness.org 70 i 9805 that are impossible to realized using conventional technologies. These Err codemadness.org 70 i 9806 encouraging results demonstrate that combining power grid big data and Err codemadness.org 70 i 9807 artificial intelligence can uncover and capture the non-linear correlation Err codemadness.org 70 i 9808 between power grid data and its stabilities indices and will potentially enable Err codemadness.org 70 i 9809 many advanced applications that can significantly improve power grid Err codemadness.org 70 i 9810 resilience. Err codemadness.org 70 i 9811

Err codemadness.org 70 i 9812

NightOwl: Robotic Platform for Wheeled Service Robot. (arXiv:2010.11505v2 [cs.RO] UPDATED)

NightOwl is a robotic platform designed exclusively for a wheeled service Err codemadness.org 70 i 9819 robot. The robot navigates autonomously in omnidirectional fashion movement and Err codemadness.org 70 i 9820 equipped with LIDAR to sense the surrounding area. The platform itself was Err codemadness.org 70 i 9821 built using the Robot Operating System (ROS) and written in two different Err codemadness.org 70 i 9822 programming languages (C++ and Python). NightOwl is composed of several modular Err codemadness.org 70 i 9823 programs, namely hardware controller, light detection and ranging (LIDAR), Err codemadness.org 70 i 9824 simultaneous localization and mapping (SLAM), world model, path planning, robot Err codemadness.org 70 i 9825 control, communication, and behaviour. The programs run in parallel and Err codemadness.org 70 i 9826 communicate reciprocally to share various information. This paper explains the Err codemadness.org 70 i 9827 role of modular programs in the term of input, process, and output. In Err codemadness.org 70 i 9828 addition, NightOwl provides simulation visualized in both Gazebo and RViz. The Err codemadness.org 70 i 9829 robot in its environment is visualized by Gazebo. Sensor data from LIDAR and Err codemadness.org 70 i 9830 results from SLAM will be visualized by RViz. Err codemadness.org 70 i 9831

Err codemadness.org 70 i 9832

Label-Aware Neural Tangent Kernel: Toward Better Generalization and Local Elasticity. (arXiv:2010.11775v2 [cs.LG] UPDATED)

As a popular approach to modeling the dynamics of training overparametrized Err codemadness.org 70 i 9839 neural networks (NNs), the neural tangent kernels (NTK) are known to fall Err codemadness.org 70 i 9840 behind real-world NNs in generalization ability. This performance gap is in Err codemadness.org 70 i 9841 part due to the \textit{label agnostic} nature of the NTK, which renders the Err codemadness.org 70 i 9842 resulting kernel not as \textit{locally elastic} as NNs~\citep{he2019local}. In Err codemadness.org 70 i 9843 this paper, we introduce a novel approach from the perspective of Err codemadness.org 70 i 9844 \emph{label-awareness} to reduce this gap for the NTK. Specifically, we propose Err codemadness.org 70 i 9845 two label-aware kernels that are each a superimposition of a label-agnostic Err codemadness.org 70 i 9846 part and a hierarchy of label-aware parts with increasing complexity of label Err codemadness.org 70 i 9847 dependence, using the Hoeffding decomposition. Through both theoretical and Err codemadness.org 70 i 9848 empirical evidence, we show that the models trained with the proposed kernels Err codemadness.org 70 i 9849 better simulate NNs in terms of generalization ability and local elasticity. Err codemadness.org 70 i 9850

Err codemadness.org 70 i 9851

The Polynomial Method is Universal for Distribution-Free Correlational SQ Learning. (arXiv:2010.11925v2 [cs.DS] UPDATED)

We consider the problem of distribution-free learning for Boolean function Err codemadness.org 70 i 9858 classes in the PAC and agnostic models. Generalizing a recent beautiful work of Err codemadness.org 70 i 9859 Malach and Shalev-Shwartz (2020) who gave the first tight correlational SQ Err codemadness.org 70 i 9860 (CSQ) lower bounds for learning DNF formulas, we show that lower bounds on the Err codemadness.org 70 i 9861 threshold or approximate degree of any function class directly imply CSQ lower Err codemadness.org 70 i 9862 bounds for PAC or agnostic learning respectively. These match corresponding Err codemadness.org 70 i 9863 positive results using upper bounds on the threshold or approximate degree in Err codemadness.org 70 i 9864 the SQ model for PAC or agnostic learning. Many of these results were implicit Err codemadness.org 70 i 9865 in earlier works of Feldman and Sherstov. Err codemadness.org 70 i 9866

Err codemadness.org 70 i 9867

Escape saddle points faster on manifolds via perturbed Riemannian stochastic recursive gradient. (arXiv:2010.12191v2 [math.OC] UPDATED)

In this paper, we propose a variant of Riemannian stochastic recursive Err codemadness.org 70 i 9874 gradient method that can achieve second-order convergence guarantee and escape Err codemadness.org 70 i 9875 saddle points using simple perturbation. The idea is to perturb the iterates Err codemadness.org 70 i 9876 when gradient is small and carry out stochastic recursive gradient updates over Err codemadness.org 70 i 9877 tangent space. This avoids the complication of exploiting Riemannian geometry. Err codemadness.org 70 i 9878 We show that under finite-sum setting, our algorithm requires Err codemadness.org 70 i 9879 $\widetilde{\mathcal{O}}\big( \frac{ \sqrt{n}}{\epsilon^2} + \frac{\sqrt{n} Err codemadness.org 70 i 9880 }{\delta^4} + \frac{n}{\delta^3}\big)$ stochastic gradient queries to find a Err codemadness.org 70 i 9881 $(\epsilon, \delta)$-second-order critical point. This strictly improves the Err codemadness.org 70 i 9882 complexity of perturbed Riemannian gradient descent and is superior to Err codemadness.org 70 i 9883 perturbed Riemannian accelerated gradient descent under large-sample settings. Err codemadness.org 70 i 9884 We also provide a complexity of $\widetilde{\mathcal{O}} \big( Err codemadness.org 70 i 9885 \frac{1}{\epsilon^3} + \frac{1}{\delta^3 \epsilon^2} + \frac{1}{\delta^4 Err codemadness.org 70 i 9886 \epsilon} \big)$ for online optimization, which is novel on Riemannian manifold Err codemadness.org 70 i 9887 in terms of second-order convergence using only first-order information. Err codemadness.org 70 i 9888

Err codemadness.org 70 i 9889

On the mechanical contribution of head stabilization to passive dynamics of anthropometric walkers. (arXiv:2010.12234v2 [cs.RO] UPDATED)

During the steady gait, humans stabilize their head around the vertical Err codemadness.org 70 i 9896 orientation. While there are sensori-cognitive explanations for this Err codemadness.org 70 i 9897 phenomenon, its mechanical e fect on the body dynamics remains un-explored. In Err codemadness.org 70 i 9898 this study, we take profit from the similarities that human steady gait share Err codemadness.org 70 i 9899 with the locomotion of passive dynamics robots. We introduce a simplified Err codemadness.org 70 i 9900 anthropometric D model to reproduce a broad walking dynamics. In a previous Err codemadness.org 70 i 9901 study, we showed heuristically that the presence of a stabilized head-neck Err codemadness.org 70 i 9902 system significantly influences the dynamics of walking. This paper gives new Err codemadness.org 70 i 9903 insights that lead to understanding this mechanical e fect. In particular, we Err codemadness.org 70 i 9904 introduce an original cart upper-body model that allows to better understand Err codemadness.org 70 i 9905 the mechanical interest of head stabilization when walking, and we study how Err codemadness.org 70 i 9906 this e fect is sensitive to the choice of control parameters. Err codemadness.org 70 i 9907

Err codemadness.org 70 i 9908

Exploring task-based query expansion at the TREC-COVID track. (arXiv:2010.12674v2 [cs.IR] UPDATED)

We explore how to generate effective queries based on search tasks. Our Err codemadness.org 70 i 9915 approach has three main steps: 1) identify search tasks based on research Err codemadness.org 70 i 9916 goals, 2) manually classify search queries according to those tasks, and 3) Err codemadness.org 70 i 9917 compare three methods to improve search rankings based on the task context. The Err codemadness.org 70 i 9918 most promising approach is based on expanding the user's query terms using task Err codemadness.org 70 i 9919 terms, which slightly improved the NDCG@20 scores over a BM25 baseline. Further Err codemadness.org 70 i 9920 improvements might be gained if we can identify more specific search tasks. Err codemadness.org 70 i 9921

Err codemadness.org 70 i 9922

Adaptive In-network Collaborative Caching for Enhanced Ensemble Deep Learning at Edge. (arXiv:2010.12899v3 [cs.NI] UPDATED)

To enhance the quality and speed of data processing and protect the privacy Err codemadness.org 70 i 9929 and security of the data, edge computing has been extensively applied to Err codemadness.org 70 i 9930 support data-intensive intelligent processing services at edge. Among these Err codemadness.org 70 i 9931 data-intensive services, ensemble learning-based services can in natural Err codemadness.org 70 i 9932 leverage the distributed computation and storage resources at edge devices to Err codemadness.org 70 i 9933 achieve efficient data collection, processing, analysis. Err codemadness.org 70 i 9934

Err codemadness.org 70 i 9935

Collaborative caching has been applied in edge computing to support services Err codemadness.org 70 i 9936 close to the data source, in order to take the limited resources at edge Err codemadness.org 70 i 9937 devices to support high-performance ensemble learning solutions. To achieve Err codemadness.org 70 i 9938 this goal, we propose an adaptive in-network collaborative caching scheme for Err codemadness.org 70 i 9939 ensemble learning at edge. First, an efficient data representation structure is Err codemadness.org 70 i 9940 proposed to record cached data among different nodes. In addition, we design a Err codemadness.org 70 i 9941 collaboration scheme to facilitate edge nodes to cache valuable data for local Err codemadness.org 70 i 9942 ensemble learning, by scheduling local caching according to a summarization of Err codemadness.org 70 i 9943 data representations from different edge nodes. Our extensive simulations Err codemadness.org 70 i 9944 demonstrate the high performance of the proposed collaborative caching scheme, Err codemadness.org 70 i 9945 which significantly reduces the learning latency and the transmission overhead. Err codemadness.org 70 i 9946

Err codemadness.org 70 i 9947

Lightning-Fast Gravitational Wave Parameter Inference through Neural Amortization. (arXiv:2010.12931v2 [astro-ph.IM] UPDATED)

Gravitational waves from compact binaries measured by the LIGO and Virgo Err codemadness.org 70 i 9954 detectors are routinely analyzed using Markov Chain Monte Carlo sampling Err codemadness.org 70 i 9955 algorithms. Because the evaluation of the likelihood function requires Err codemadness.org 70 i 9956 evaluating millions of waveform models that link between signal shapes and the Err codemadness.org 70 i 9957 source parameters, running Markov chains until convergence is typically Err codemadness.org 70 i 9958 expensive and requires days of computation. In this extended abstract, we Err codemadness.org 70 i 9959 provide a proof of concept that demonstrates how the latest advances in neural Err codemadness.org 70 i 9960 simulation-based inference can speed up the inference time by up to three Err codemadness.org 70 i 9961 orders of magnitude -- from days to minutes -- without impairing the Err codemadness.org 70 i 9962 performance. Our approach is based on a convolutional neural network modeling Err codemadness.org 70 i 9963 the likelihood-to-evidence ratio and entirely amortizes the computation of the Err codemadness.org 70 i 9964 posterior. We find that our model correctly estimates credible intervals for Err codemadness.org 70 i 9965 the parameters of simulated gravitational waves. Err codemadness.org 70 i 9966

Err codemadness.org 70 i 9967

A Survey on Churn Analysis. (arXiv:2010.13119v2 [cs.LG] UPDATED)

In this paper, I present churn prediction techniques that have been released Err codemadness.org 70 i 9974 so far. Churn prediction is used in the fields of Internet services, games, Err codemadness.org 70 i 9975 insurance, and management. However, since it has been used intensively to Err codemadness.org 70 i 9976 increase the predictability of various industry/academic fields, there is a big Err codemadness.org 70 i 9977 difference in its definition and utilization. In this paper, I collected the Err codemadness.org 70 i 9978 definitions of churn used in the fields of business administration, marketing, Err codemadness.org 70 i 9979 IT, telecommunications, newspapers, insurance and psychology, and described Err codemadness.org 70 i 9980 their differences. Based on this, I classified and explained churn loss, Err codemadness.org 70 i 9981 feature engineering, and prediction models. Our study can be used to select the Err codemadness.org 70 i 9982 definition of churn and its associated models suitable for the service field Err codemadness.org 70 i 9983 that researchers are most interested in by integrating fragmented churn studies Err codemadness.org 70 i 9984 in industry/academic fields. Err codemadness.org 70 i 9985

Err codemadness.org 70 i 9986

Geometric Exploration for Online Control. (arXiv:2010.13178v2 [cs.LG] UPDATED)

We study the control of an \emph{unknown} linear dynamical system under Err codemadness.org 70 i 9993 general convex costs. The objective is minimizing regret vs. the class of Err codemadness.org 70 i 9994 disturbance-feedback-controllers, which encompasses all stabilizing Err codemadness.org 70 i 9995 linear-dynamical-controllers. In this work, we first consider the case of known Err codemadness.org 70 i 9996 cost functions, for which we design the first polynomial-time algorithm with Err codemadness.org 70 i 9997 $n^3\sqrt{T}$-regret, where $n$ is the dimension of the state plus the Err codemadness.org 70 i 9998 dimension of control input. The $\sqrt{T}$-horizon dependence is optimal, and Err codemadness.org 70 i 9999 improves upon the previous best known bound of $T^{2/3}$. The main component of Err codemadness.org 70 i 10000 our algorithm is a novel geometric exploration strategy: we adaptively Err codemadness.org 70 i 10001 construct a sequence of barycentric spanners in the policy space. Second, we Err codemadness.org 70 i 10002 consider the case of bandit feedback, for which we give the first Err codemadness.org 70 i 10003 polynomial-time algorithm with $poly(n)\sqrt{T}$-regret, building on Stochastic Err codemadness.org 70 i 10004 Bandit Convex Optimization. Err codemadness.org 70 i 10005

Err codemadness.org 70 i 10006

Efficient Joinable Table Discovery in Data Lakes: A High-Dimensional Similarity-Based Approach. (arXiv:2010.13273v2 [cs.IR] UPDATED)

Finding joinable tables in data lakes is key procedure in many applications Err codemadness.org 70 i 10013 such as data integration, data augmentation, data analysis, and data market. Err codemadness.org 70 i 10014 Traditional approaches that find equi-joinable tables are unable to deal with Err codemadness.org 70 i 10015 misspellings and different formats, nor do they capture any semantic joins. In Err codemadness.org 70 i 10016 this paper, we propose PEXESO, a framework for joinable table discovery in data Err codemadness.org 70 i 10017 lakes. We embed textual values as high-dimensional vectors and join columns Err codemadness.org 70 i 10018 under similarity predicates on high-dimensional vectors, hence to address the Err codemadness.org 70 i 10019 limitations of equi-join approaches and identify more meaningful results. To Err codemadness.org 70 i 10020 efficiently find joinable tables with similarity, we propose a block-and-verify Err codemadness.org 70 i 10021 method that utilizes pivot-based filtering. A partitioning technique is Err codemadness.org 70 i 10022 developed to cope with the case when the data lake is large and the index Err codemadness.org 70 i 10023 cannot fit in main memory. An experimental evaluation on real datasets shows Err codemadness.org 70 i 10024 that our solution identifies substantially more tables than equi-joins and Err codemadness.org 70 i 10025 outperforms other similarity-based options, and the join results are useful in Err codemadness.org 70 i 10026 data enrichment for machine learning tasks. The experiments also demonstrate Err codemadness.org 70 i 10027 the efficiency of the proposed method. Err codemadness.org 70 i 10028

Err codemadness.org 70 i 10029

Malicious Requests Detection with Improved Bidirectional Long Short-term Memory Neural Networks. (arXiv:2010.13285v2 [cs.LG] UPDATED)

Detecting and intercepting malicious requests are one of the most widely used Err codemadness.org 70 i 10036 ways against attacks in the network security. Most existing detecting Err codemadness.org 70 i 10037 approaches, including matching blacklist characters and machine learning Err codemadness.org 70 i 10038 algorithms have all shown to be vulnerable to sophisticated attacks. To address Err codemadness.org 70 i 10039 the above issues, a more general and rigorous detection method is required. In Err codemadness.org 70 i 10040 this paper, we formulate the problem of detecting malicious requests as a Err codemadness.org 70 i 10041 temporal sequence classification problem, and propose a novel deep learning Err codemadness.org 70 i 10042 model namely Convolutional Neural Network-Bidirectional Long Short-term Err codemadness.org 70 i 10043 Memory-Convolutional Neural Network (CNN-BiLSTM-CNN). By connecting the shadow Err codemadness.org 70 i 10044 and deep feature maps of the convolutional layers, the malicious feature Err codemadness.org 70 i 10045 extracting ability is improved on more detailed functionality. Experimental Err codemadness.org 70 i 10046 results on HTTP dataset CSIC 2010 have demonstrated the effectiveness of the Err codemadness.org 70 i 10047 proposed method when compared with the state-of-the-arts. Err codemadness.org 70 i 10048

Err codemadness.org 70 i 10049

Recent Developments on ESPnet Toolkit Boosted by Conformer. (arXiv:2010.13956v2 [eess.AS] UPDATED)

In this study, we present recent developments on ESPnet: End-to-End Speech Err codemadness.org 70 i 10056 Processing toolkit, which mainly involves a recently proposed architecture Err codemadness.org 70 i 10057 called Conformer, Convolution-augmented Transformer. This paper shows the Err codemadness.org 70 i 10058 results for a wide range of end-to-end speech processing applications, such as Err codemadness.org 70 i 10059 automatic speech recognition (ASR), speech translations (ST), speech separation Err codemadness.org 70 i 10060 (SS) and text-to-speech (TTS). Our experiments reveal various training tips and Err codemadness.org 70 i 10061 significant performance benefits obtained with the Conformer on different Err codemadness.org 70 i 10062 tasks. These results are competitive or even outperform the current Err codemadness.org 70 i 10063 state-of-art Transformer models. We are preparing to release all-in-one recipes Err codemadness.org 70 i 10064 using open source and publicly available corpora for all the above tasks with Err codemadness.org 70 i 10065 pre-trained models. Our aim for this work is to contribute to our research Err codemadness.org 70 i 10066 community by reducing the burden of preparing state-of-the-art research Err codemadness.org 70 i 10067 environments usually requiring high resources. Err codemadness.org 70 i 10068

Err codemadness.org 70 i 10069

Simultaenous Sieves: A Deterministic Streaming Algorithm for Non-Monotone Submodular Maximization. (arXiv:2010.14367v2 [cs.DS] UPDATED)

In this work, we present a combinatorial, deterministic single-pass streaming Err codemadness.org 70 i 10076 algorithm for the problem of maximizing a submodular function, not necessarily Err codemadness.org 70 i 10077 monotone, with respect to a cardinality constraint (SMCC). In the case the Err codemadness.org 70 i 10078 function is monotone, our algorithm reduces to the optimal streaming algorithm Err codemadness.org 70 i 10079 of Badanidiyuru et al. (2014). In general, our algorithm achieves ratio $\alpha Err codemadness.org 70 i 10080 / (1 + \alpha) - \varepsilon$, for any $\varepsilon > 0$, where $\alpha$ is the Err codemadness.org 70 i 10081 ratio of an offline (deterministic) algorithm for SMCC used for Err codemadness.org 70 i 10082 post-processing. Thus, if exponential computation time is allowed, our Err codemadness.org 70 i 10083 algorithm deterministically achieves nearly the optimal $1/2$ ratio. These Err codemadness.org 70 i 10084 results nearly match those of a recently proposed, randomized streaming Err codemadness.org 70 i 10085 algorithm that achieves the same ratios in expectation. For a deterministic, Err codemadness.org 70 i 10086 single-pass streaming algorithm, our algorithm achieves in polynomial time an Err codemadness.org 70 i 10087 improvement of the best approximation factor from $1/9$ of previous literature Err codemadness.org 70 i 10088 to $\approx 0.2689$. Err codemadness.org 70 i 10089

Err codemadness.org 70 i 10090

Memory Optimization for Deep Networks. (arXiv:2010.14501v2 [cs.LG] UPDATED)

Deep learning is slowly, but steadily, hitting a memory bottleneck. While the Err codemadness.org 70 i 10097 tensor computation in top-of-the-line GPUs increased by 32x over the last five Err codemadness.org 70 i 10098 years, the total available memory only grew by 2.5x. This prevents researchers Err codemadness.org 70 i 10099 from exploring larger architectures, as training large networks requires more Err codemadness.org 70 i 10100 memory for storing intermediate outputs. In this paper, we present MONeT, an Err codemadness.org 70 i 10101 automatic framework that minimizes both the memory footprint and computational Err codemadness.org 70 i 10102 overhead of deep networks. MONeT jointly optimizes the checkpointing schedule Err codemadness.org 70 i 10103 and the implementation of various operators. MONeT is able to outperform all Err codemadness.org 70 i 10104 prior hand-tuned operations as well as automated checkpointing. MONeT reduces Err codemadness.org 70 i 10105 the overall memory requirement by 3x for various PyTorch models, with a 9-16% Err codemadness.org 70 i 10106 overhead in computation. For the same computation cost, MONeT requires 1.2-1.8x Err codemadness.org 70 i 10107 less memory than current state-of-the-art automated checkpointing frameworks. Err codemadness.org 70 i 10108 Our code is available at https://github.com/utsaslab/MONeT. Err codemadness.org 70 i 10109

Err codemadness.org 70 i 10110

Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus. (arXiv:2010.14571v2 [cs.CL] UPDATED)

Large text corpora are increasingly important for a wide variety of Natural Err codemadness.org 70 i 10117 Language Processing (NLP) tasks, and automatic language identification (LangID) Err codemadness.org 70 i 10118 is a core technology needed to collect such datasets in a multilingual context. Err codemadness.org 70 i 10119 LangID is largely treated as solved in the literature, with models reported Err codemadness.org 70 i 10120 that achieve over 90% average F1 on as many as 1,366 languages. We train LangID Err codemadness.org 70 i 10121 models on up to 1,629 languages with comparable quality on held-out test sets, Err codemadness.org 70 i 10122 but find that human-judged LangID accuracy for web-crawl text corpora created Err codemadness.org 70 i 10123 using these models is only around 5% for many lower-resource languages, Err codemadness.org 70 i 10124 suggesting a need for more robust evaluation. Further analysis revealed a Err codemadness.org 70 i 10125 variety of error modes, arising from domain mismatch, class imbalance, language Err codemadness.org 70 i 10126 similarity, and insufficiently expressive models. We propose two classes of Err codemadness.org 70 i 10127 techniques to mitigate these errors: wordlist-based tunable-precision filters Err codemadness.org 70 i 10128 (for which we release curated lists in about 500 languages) and Err codemadness.org 70 i 10129 transformer-based semi-supervised LangID models, which increase median dataset Err codemadness.org 70 i 10130 precision from 5.5% to 71.2%. These techniques enable us to create an initial Err codemadness.org 70 i 10131 data set covering 100K or more relatively clean sentences in each of 500+ Err codemadness.org 70 i 10132 languages, paving the way towards a 1,000-language web text corpus. Err codemadness.org 70 i 10133

Err codemadness.org 70 i 10134

Predicting Themes within Complex Unstructured Texts: A Case Study on Safeguarding Reports. (arXiv:2010.14584v2 [cs.CL] UPDATED)

The task of text and sentence classification is associated with the need for Err codemadness.org 70 i 10141 large amounts of labelled training data. The acquisition of high volumes of Err codemadness.org 70 i 10142 labelled datasets can be expensive or unfeasible, especially for Err codemadness.org 70 i 10143 highly-specialised domains for which documents are hard to obtain. Research on Err codemadness.org 70 i 10144 the application of supervised classification based on small amounts of training Err codemadness.org 70 i 10145 data is limited. In this paper, we address the combination of state-of-the-art Err codemadness.org 70 i 10146 deep learning and classification methods and provide an insight into what Err codemadness.org 70 i 10147 combination of methods fit the needs of small, domain-specific, and Err codemadness.org 70 i 10148 terminologically-rich corpora. We focus on a real-world scenario related to a Err codemadness.org 70 i 10149 collection of safeguarding reports comprising learning experiences and Err codemadness.org 70 i 10150 reflections on tackling serious incidents involving children and vulnerable Err codemadness.org 70 i 10151 adults. The relatively small volume of available reports and their use of Err codemadness.org 70 i 10152 highly domain-specific terminology makes the application of automated Err codemadness.org 70 i 10153 approaches difficult. We focus on the problem of automatically identifying the Err codemadness.org 70 i 10154 main themes in a safeguarding report using supervised classification Err codemadness.org 70 i 10155 approaches. Our results show the potential of deep learning models to simulate Err codemadness.org 70 i 10156 subject-expert behaviour even for complex tasks with limited labelled data. Err codemadness.org 70 i 10157

Err codemadness.org 70 i 10158

Batch Reinforcement Learning with a Nonparametric Off-Policy Policy Gradient. (arXiv:2010.14771v2 [cs.LG] UPDATED)

Off-policy Reinforcement Learning (RL) holds the promise of better data Err codemadness.org 70 i 10165 efficiency as it allows sample reuse and potentially enables safe interaction Err codemadness.org 70 i 10166 with the environment. Current off-policy policy gradient methods either suffer Err codemadness.org 70 i 10167 from high bias or high variance, delivering often unreliable estimates. The Err codemadness.org 70 i 10168 price of inefficiency becomes evident in real-world scenarios such as Err codemadness.org 70 i 10169 interaction-driven robot learning, where the success of RL has been rather Err codemadness.org 70 i 10170 limited, and a very high sample cost hinders straightforward application. In Err codemadness.org 70 i 10171 this paper, we propose a nonparametric Bellman equation, which can be solved in Err codemadness.org 70 i 10172 closed form. The solution is differentiable w.r.t the policy parameters and Err codemadness.org 70 i 10173 gives access to an estimation of the policy gradient. In this way, we avoid the Err codemadness.org 70 i 10174 high variance of importance sampling approaches, and the high bias of Err codemadness.org 70 i 10175 semi-gradient methods. We empirically analyze the quality of our gradient Err codemadness.org 70 i 10176 estimate against state-of-the-art methods, and show that it outperforms the Err codemadness.org 70 i 10177 baselines in terms of sample efficiency on classical control tasks. Err codemadness.org 70 i 10178

Err codemadness.org 70 i 10179

Transferable Universal Adversarial Perturbations Using Generative Models. (arXiv:2010.14919v2 [cs.CV] UPDATED)

Deep neural networks tend to be vulnerable to adversarial perturbations, Err codemadness.org 70 i 10186 which by adding to a natural image can fool a respective model with high Err codemadness.org 70 i 10187 confidence. Recently, the existence of image-agnostic perturbations, also known Err codemadness.org 70 i 10188 as universal adversarial perturbations (UAPs), were discovered. However, Err codemadness.org 70 i 10189 existing UAPs still lack a sufficiently high fooling rate, when being applied Err codemadness.org 70 i 10190 to an unknown target model. In this paper, we propose a novel deep learning Err codemadness.org 70 i 10191 technique for generating more transferable UAPs. We utilize a perturbation Err codemadness.org 70 i 10192 generator and some given pretrained networks so-called source models to Err codemadness.org 70 i 10193 generate UAPs using the ImageNet dataset. Due to the similar feature Err codemadness.org 70 i 10194 representation of various model architectures in the first layer, we propose a Err codemadness.org 70 i 10195 loss formulation that focuses on the adversarial energy only in the respective Err codemadness.org 70 i 10196 first layer of the source models. This supports the transferability of our Err codemadness.org 70 i 10197 generated UAPs to any other target model. We further empirically analyze our Err codemadness.org 70 i 10198 generated UAPs and demonstrate that these perturbations generalize very well Err codemadness.org 70 i 10199 towards different target models. Surpassing the current state of the art in Err codemadness.org 70 i 10200 both, fooling rate and model-transferability, we can show the superiority of Err codemadness.org 70 i 10201 our proposed approach. Using our generated non-targeted UAPs, we obtain an Err codemadness.org 70 i 10202 average fooling rate of 93.36% on the source models (state of the art: 82.16%). Err codemadness.org 70 i 10203 Generating our UAPs on the deep ResNet-152, we obtain about a 12% absolute Err codemadness.org 70 i 10204 fooling rate advantage vs. cutting-edge methods on VGG-16 and VGG-19 target Err codemadness.org 70 i 10205 models. Err codemadness.org 70 i 10206

Err codemadness.org 70 i 10207

Estimating Multiplicative Relations in Neural Networks. (arXiv:2010.15003v2 [cs.LG] UPDATED)

Universal approximation theorem suggests that a shallow neural network can Err codemadness.org 70 i 10214 approximate any function. The input to neurons at each layer is a weighted sum Err codemadness.org 70 i 10215 of previous layer neurons and then an activation is applied. These activation Err codemadness.org 70 i 10216 functions perform very well when the output is a linear combination of input Err codemadness.org 70 i 10217 data. When trying to learn a function which involves product of input data, the Err codemadness.org 70 i 10218 neural networks tend to overfit the data to approximate the function. In this Err codemadness.org 70 i 10219 paper we will use properties of logarithmic functions to propose a pair of Err codemadness.org 70 i 10220 activation functions which can translate products into linear expression and Err codemadness.org 70 i 10221 learn using backpropagation. We will try to generalize this approach for some Err codemadness.org 70 i 10222 complex arithmetic functions and test the accuracy on a disjoint distribution Err codemadness.org 70 i 10223 with the training set. Err codemadness.org 70 i 10224

Err codemadness.org 70 i 10225

Benchmarking Parallelism in FaaS Platforms. (arXiv:2010.15032v2 [cs.DC] UPDATED)

Serverless computing has seen a myriad of work exploring its potential. Some Err codemadness.org 70 i 10232 systems tackle Function-as-a-Service (FaaS) properties on automatic elasticity Err codemadness.org 70 i 10233 and scale to run highly-parallel computing jobs. However, they focus on Err codemadness.org 70 i 10234 specific platforms and convey that their ideas can be extrapolated to any FaaS Err codemadness.org 70 i 10235 runtime. Err codemadness.org 70 i 10236

Err codemadness.org 70 i 10237

An important question arises: do all FaaS platforms fit parallel Err codemadness.org 70 i 10238 computations? In this paper, we argue that not all of them provide the Err codemadness.org 70 i 10239 necessary means to host highly-parallel applications. To validate our Err codemadness.org 70 i 10240 hypothesis, we create a comparative framework and categorize the architectures Err codemadness.org 70 i 10241 of four cloud FaaS offerings, with emphasis on parallel performance. We attest Err codemadness.org 70 i 10242 and extend this description with an empirical experiment that consists in Err codemadness.org 70 i 10243 plotting in deep detail the evolution of a parallel computing job on each Err codemadness.org 70 i 10244 service. Err codemadness.org 70 i 10245

Err codemadness.org 70 i 10246

The analysis of our results evinces that FaaS is not inherently good for Err codemadness.org 70 i 10247 parallel computations and architectural differences across platforms are Err codemadness.org 70 i 10248 decisive to categorize their performance. A key insight is the importance of Err codemadness.org 70 i 10249 virtualization technologies and the scheduling approach of FaaS platforms. Err codemadness.org 70 i 10250 Parallelism improves with lighter virtualization and proactive scheduling due Err codemadness.org 70 i 10251 to finer resource allocation and faster elasticity. This causes some platforms Err codemadness.org 70 i 10252 like AWS and IBM to perform well for highly-parallel computations, while others Err codemadness.org 70 i 10253 such as Azure present difficulties to achieve the required parallelism degree. Err codemadness.org 70 i 10254 Consequently, the information in this paper becomes of special interest to help Err codemadness.org 70 i 10255 users choose the most adequate infrastructure for their parallel applications. Err codemadness.org 70 i 10256

Err codemadness.org 70 i 10257

Measuring non-trivial compositionality in emergent communication. (arXiv:2010.15058v2 [cs.NE] UPDATED)

Compositionality is an important explanatory target in emergent communication Err codemadness.org 70 i 10264 and language evolution. The vast majority of computational models of Err codemadness.org 70 i 10265 communication account for the emergence of only a very basic form of Err codemadness.org 70 i 10266 compositionality: trivial compositionality. A compositional protocol is Err codemadness.org 70 i 10267 trivially compositional if the meaning of a complex signal (e.g. blue circle) Err codemadness.org 70 i 10268 boils down to the intersection of meanings of its constituents (e.g. the Err codemadness.org 70 i 10269 intersection of the set of blue objects and the set of circles). A protocol is Err codemadness.org 70 i 10270 non-trivially compositional (NTC) if the meaning of a complex signal (e.g. Err codemadness.org 70 i 10271 biggest apple) is a more complex function of the meanings of their Err codemadness.org 70 i 10272 constituents. In this paper, we review several metrics of compositionality used Err codemadness.org 70 i 10273 in emergent communication and experimentally show that most of them fail to Err codemadness.org 70 i 10274 detect NTC - i.e. they treat non-trivial compositionality as a failure of Err codemadness.org 70 i 10275 compositionality. The one exception is tree reconstruction error, a metric Err codemadness.org 70 i 10276 motivated by formal accounts of compositionality. These results emphasise Err codemadness.org 70 i 10277 important limitations of emergent communication research that could hamper Err codemadness.org 70 i 10278 progress on modelling the emergence of NTC. Err codemadness.org 70 i 10279

Err codemadness.org 70 i 10280

The fundamental equations of change in statistical ensembles and biological populations. (arXiv:2010.14544v1 [q-bio.PE] CROSS LISTED)

A recent article in Nature Physics unified key results from thermodynamics, Err codemadness.org 70 i 10287 statistics, and information theory. The unification arose from a general Err codemadness.org 70 i 10288 equation for the rate of change in the information content of a system. The Err codemadness.org 70 i 10289 general equation describes the change in the moments of an observable quantity Err codemadness.org 70 i 10290 over a probability distribution. One term in the equation describes the change Err codemadness.org 70 i 10291 in the probability distribution. The other term describes the change in the Err codemadness.org 70 i 10292 observable values for a given state. We show the equivalence of this general Err codemadness.org 70 i 10293 equation for moment dynamics with the widely known Price equation from Err codemadness.org 70 i 10294 evolutionary theory, named after George Price. We introduce the Price equation Err codemadness.org 70 i 10295 from its biological roots, review a mathematically abstract form of the Err codemadness.org 70 i 10296 equation, and discuss the potential for this equation to unify diverse Err codemadness.org 70 i 10297 mathematical theories from different disciplines. The new work in Nature Err codemadness.org 70 i 10298 Physics and many applications in biology show that this equation also provides Err codemadness.org 70 i 10299 the basis for deriving many novel theoretical results within each discipline. Err codemadness.org 70 i 10300

Err codemadness.org 70 i 10301

Generalized eigen, singular value, and partial least squares decompositions: The GSVD package. (arXiv:2010.14734v2 [cs.MS] CROSS LISTED)

The generalized singular value decomposition (GSVD, a.k.a. "SVD triplet", Err codemadness.org 70 i 10308 "duality diagram" approach) provides a unified strategy and basis to perform Err codemadness.org 70 i 10309 nearly all of the most common multivariate analyses (e.g., principal Err codemadness.org 70 i 10310 components, correspondence analysis, multidimensional scaling, canonical Err codemadness.org 70 i 10311 correlation, partial least squares). Though the GSVD is ubiquitous, powerful, Err codemadness.org 70 i 10312 and flexible, it has very few implementations. Here I introduce the GSVD Err codemadness.org 70 i 10313 package for R. The general goal of GSVD is to provide a small set of accessible Err codemadness.org 70 i 10314 functions to perform the GSVD and two other related decompositions (generalized Err codemadness.org 70 i 10315 eigenvalue decomposition, generalized partial least squares-singular value Err codemadness.org 70 i 10316 decomposition). Furthermore, GSVD helps provide a more unified conceptual Err codemadness.org 70 i 10317 approach and nomenclature to many techniques. I first introduce the concept of Err codemadness.org 70 i 10318 the GSVD, followed by a formal definition of the generalized decompositions. Err codemadness.org 70 i 10319 Next I provide some key decisions made during development, and then a number of Err codemadness.org 70 i 10320 examples of how to use GSVD to implement various statistical techniques. These Err codemadness.org 70 i 10321 examples also illustrate one of the goals of GSVD: how others can (or should) Err codemadness.org 70 i 10322 build analysis packages that depend on GSVD. Finally, I discuss the possible Err codemadness.org 70 i 10323 future of GSVD. Err codemadness.org 70 i 10324

Err codemadness.org 70 i 10325

Continuous Chaotic Nonlinear System and Lyapunov controller Optimization using Deep Learning. (arXiv:2010.14746v1 [eess.SY] CROSS LISTED)

The introduction of unexpected system disturbances and new system dynamics Err codemadness.org 70 i 10332 does not allow initially selected static system and controller parameters to Err codemadness.org 70 i 10333 guarantee continued system stability and performance. In this research we Err codemadness.org 70 i 10334 present a novel approach for detecting early failure indicators of non-linear Err codemadness.org 70 i 10335 highly chaotic system and accordingly predict the best parameter calibrations Err codemadness.org 70 i 10336 to offset such instability using deep machine learning regression model. The Err codemadness.org 70 i 10337 approach proposed continuously monitors the system and controller signals. The Err codemadness.org 70 i 10338 Re-calibration of the system and controller parameters is triggered according Err codemadness.org 70 i 10339 to a set of conditions designed to maintain system stability without compromise Err codemadness.org 70 i 10340 to the system speed, intended outcome or required processing power. The deep Err codemadness.org 70 i 10341 neural model predicts the parameter values that would best counteract the Err codemadness.org 70 i 10342 expected system in-stability. To demonstrate the effectiveness of the proposed Err codemadness.org 70 i 10343 approach, it is applied to the non-linear complex combination of Duffing Van Err codemadness.org 70 i 10344 der pol oscillators. The approach is also tested under different scenarios the Err codemadness.org 70 i 10345 system and controller parameters are initially chosen incorrectly or the system Err codemadness.org 70 i 10346 parameters are changed while running or new system dynamics are introduced Err codemadness.org 70 i 10347 while running to measure effectiveness and reaction time. Err codemadness.org 70 i 10348

Err codemadness.org 70 i 10349