Browsing by Author "Yang, Xiaoxuan"
- Results Per Page
- Sort Options
Item Open Access Changes in U.S. Residential Monthly Energy Use per Capita: 1990-2017(2019) Yang, XiaoxuanResidential energy consumption represents a large share of total end use energy and shows strong correlation with monthly cooling and heating degree days. This study focuses on quantifying temporal change in the relationship between monthly degree days and monthly U.S. residential use of electricity and natural gas for each of the 48 contiguous states from 1990 to 2017. We introduce a single degree day predicator to characterize the non-linear relationship between degree-day and state-level electricity and natural gas use. By looking at trends in three DD-energy use coordinates and curvature from single quadratic fits on a year-by-year and state-by-state basis, we confirm the non-linear relationship between DD and residential energy use and reveal processes that might influence the relationship. We find that residential electricity energy use has become more sensitive to seasonal fluctuations in temperature in most states. While the lowest electricity use per year has risen, natural gas use has fallen since 1990 in most states. We further group the states into 17 classes for electricity use and 21 classes for natural gas use based on combinations of temporal trends in quadratic curve variables. These large groupings for electricity have shown a similar spatial distribution as that of the climate regions defined by the U.S. Department of Energy, reaffirming temperature and humidity as influential factors in the climate-energy relationship. We also compare our results with the household and end uses information from U.S. Energy Information Administration’s Residential Energy Consumption (REC) Surveys and recognize electricity as a growing heating source in all U.S. regions. We further address economic development, energy efficiency of end uses, and building codes as potential trends that affect the relationship between degree day and residential energy use at national, regional and state levels.
Item Open Access Improving the Efficiency and Robustness of In-Memory Computing in Emerging Technologies(2023) Yang, XiaoxuanEmerging technologies, such as resistive random-access memory (ReRAM), have proven their potential in in-memory computing for deep learning applications. My dissertation work focuses on improving the efficiency and robustness of in-memory computing in emerging technologies.
Existing ReRAM-based processing-in-memory (PIM) designs can support the inferencing and the training of neural networks, such as convolutional neural networks and recurrent neural networks. However, these designs suffer from the re-writing procedure for the self-attention calculation. Therefore, I propose an architecture that enables the efficient self-attention mechanism in PIM design. The optimized calculation procedure and finer granularity pipeline design improve efficiency. The contributions lie in enabling feasible and efficient ReRAM-based PIM designs for attention-based models.
Inferencing with ReRAM-based design has one severe problem: the inferencing accuracy can be degraded due to the non-idealities in hardware devices. The robustness of the previous method is not validated under the combination of device stochastic noise. With the proposed hardware-aware training method, the robustness of inferencing accuracy can be improved. Besides, with hardware efficiency and inferencing robustness targets, the multi-objective optimization method is developed to explore the design space and generate high-quality Pareto-optimal design configurations with minimal cost. This work integrates attributes from the design space and the evaluation space and develops efficient hardware-software co-design methods.
Training with ReRAM-based design has one challenging endurance problem due to the frequent weight updates for neural network training. The expectation for endurance management is to decrease the number of weight updates and balance the write accesses. The proposed endurance-aware training method utilizes gradient structure pruning and dynamically structurally adjusts the write probabilities. This method can expand the life cycle for ReRAM during the training process.
In summary, the research above targets realizing efficient self-attention mechanisms and solving accuracy degradation and endurance problems for the inferencing and training processes. Besides, the efforts lie in figuring out the challenging parts of each topic and developing hardware-software co-design considering efficiency and robustness. The developed designs are the potential solutions for the challenging problems of in-memory computing in emerging technologies.