https://arstechnica.com/tech-policy/2024/04/feds-appoint-ai-doomer-to-run-us-ai-safety-institute/ Article intro: Appointed as head of AI safety is Paul Christiano, a former OpenAI researcher who pioneered a foundational AI safety technique called reinforcement learning from human feedback (RLHF), but is also known for predicting that "there's a 50 percent chance AI development could end in 'doom.'" While Christiano's research background is impressive, some fear that by appointing a so-called "AI doomer," NIST may be risking encouraging non-scientific thinking that many critics view as sheer speculation. submitted by /u/bregav [link] [comments]

Hey All, I think many of us can agree that defining the hardware we want to use right next to the piece of code we are running is objectively a much better developer experience. I have always loved the idea of lowering the barrier when it comes to running code in the cloud. As more cloud abstractions hit the market, I was honestly really surprised by the lack of adoption. There aren't any unicorns (I don't think any actually) in this space yet, just series A businesses. After speaking with a handful of Data Scientists, Machine Learning Engineers, and DevOps Engineers, it started to dawn on me that risk aversion is causing most of the friction. Using a fully managed service can definitely have some upsides, and in many cases, I prefer using them, but convincing your boss to pipe petabytes of data to another company's cloud and incur 3-5x compute costs probably isn't going to sit well. There are also some open source alternatives but they are intentionally difficult to configure so you pay for their premium offerings that reduce config setup. Would love to hear everyone's thoughts, especially those who work at lean startups and global 5,000 companies. submitted by /u/Ok_Post_149 [link] [comments]

I am curious to know the job opportunities in Banking & Insurance for someone pursuing PhD in Statistics given the current market conditions. submitted by /u/SpiritualCellist4303 [link] [comments]

Title. Is there a way to determine the degree of sphericity or hyperbolicity of the embeddings a feature extractor learns for a set of examples it has been trained on / will be tested on? I am new to geometry in deep learning. It would be amazing if anyone could also point me to a paper or a book to get started on this. Thanks in advance. submitted by /u/Mad_Scientist2027 [link] [comments]

Paper: https://arxiv.org/abs/2104.10751 Package: https://github.com/sametcopur/ruleopt Documentation: https://ruleopt.readthedocs.io/ RuleOpt is an optimization-based rule learning algorithm designed for classification problems. Focusing on scalability and interpretability, RuleOpt utilizes linear programming for rule generation and extraction. The Python library ruleopt is capable of extracting rules from ensemble models, and it also implements a novel rule generation scheme. The library ensures compatibility with existing machine learning pipelines, and it is especially efficient for tackling large-scale problems. Here are a few highlights of ruleopt: Efficient Rule Generation and Extraction: Leverages linear programming for scalable rule generation (stand-alone machine learning method) and rule extraction from trained random forest and boosting models. Interpretability: Prioritizes model transparency by assigning costs to rules in order to achieve a desirable balance with accuracy. Integration with Machine Learning Libraries: Facilitates smooth integration with well-known Python libraries scikit-learn, LightGBM, and XGBoost, and existing machine learning pipelines. Extensive Solver Support: Supports a wide array of solvers, including Gurobi, CPLEX and OR-Tools. submitted by /u/zedeleyici3401 [link] [comments]

I've been using LSTM models for time series forecasting and have noticed they perform well for predicting the immediate next step. However, when attempting multi-step predictions to forecast one week ahead (168 periods, with hourly data), the performance drops significantly. Currently, I'm using a recursive approach: feeding back the prediction as the next input (closed loop). This method isn't yielding good results, although open loop predictions are much more accurate. Is there a better technique for enhancing LSTM's multi-step prediction accuracy? Are LSTMs not useful for doing multi step forecasting? Any links or resources to articles explain multi step forecasting with LSTMs would be appreciated. https://preview.redd.it/30y3m16gr3vc1.png?width=833&format=png&auto=webp&s=6d6b29e05b105b50d2689127ea6881d1ec667903 https://preview.redd.it/a971j16gr3vc1.png?width=833&format=png&auto=webp&s=fec277d9343c5f702247a6135dbb630358c14cca submitted by /u/StressAccomplished26 [link] [comments]

Paper: https://arxiv.org/abs/2404.07738 Abstract: Scientific Research, vital for improving human life, is hindered by its inherent complexity, slow pace, and the need for specialized experts. To enhance its productivity, we propose a ResearchAgent, a large language model-powered research idea writing agent, which automatically generates problems, methods, and experiment designs while iteratively refining them based on scientific literature. Specifically, starting with a core paper as the primary focus to generate ideas, our ResearchAgent is augmented not only with relevant publications through connecting information over an academic graph but also entities retrieved from an entity-centric knowledge store based on their underlying concepts, mined and shared across numerous papers. In addition, mirroring the human approach to iteratively improving ideas with peer discussions, we leverage multiple ReviewingAgents that provide reviews and feedback iteratively. Further, they are instantiated with human preference-aligned large language models whose criteria for evaluation are derived from actual human judgments. We experimentally validate our ResearchAgent on scientific publications across multiple disciplines, showcasing its effectiveness in generating novel, clear, and valid research ideas based on human and model-based evaluation results. submitted by /u/SeawaterFlows [link] [comments]

Paper: https://arxiv.org/abs/2404.09967 Code: https://github.com/HL-hanlin/Ctrl-Adapter Models: https://huggingface.co/hanlincs/Ctrl-Adapter Project page: https://ctrl-adapter.github.io/ Abstract: ControlNets are widely used for adding spatial control in image generation with different conditions, such as depth maps, canny edges, and human poses. However, there are several challenges when leveraging the pretrained image ControlNets for controlled video generation. First, pretrained ControlNet cannot be directly plugged into new backbone models due to the mismatch of feature spaces, and the cost of training ControlNets for new backbones is a big burden. Second, ControlNet features for different frames might not effectively handle the temporal consistency. To address these challenges, we introduce Ctrl-Adapter, an efficient and versatile framework that adds diverse controls to any image/video diffusion models, by adapting pretrained ControlNets (and improving temporal alignment for videos). Ctrl-Adapter provides diverse capabilities including image control, video control, video control with sparse frames, multi-condition control, compatibility with different backbones, adaptation to unseen control conditions, and video editing. In Ctrl-Adapter, we train adapter layers that fuse pretrained ControlNet features to different image/video diffusion models, while keeping the parameters of the ControlNets and the diffusion models frozen. Ctrl-Adapter consists of temporal and spatial modules so that it can effectively handle the temporal consistency of videos. We also propose latent skipping and inverse timestep sampling for robust adaptation and sparse control. Moreover, Ctrl-Adapter enables control from multiple conditions by simply taking the (weighted) average of ControlNet outputs. With diverse image/video diffusion backbones (SDXL, Hotshot-XL, I2VGen-XL, and SVD), Ctrl-Adapter matches ControlNet for image control and outperforms all baselines for video control (achieving the SOTA accuracy on the DAVIS 2017 dataset) with significantly lower computational costs (less than 10 GPU hours). submitted by /u/SeawaterFlows [link] [comments]

Hello! I am a researcher in computational neuroscience, looking to apply some contemporary machine learning techniques to fMRI timeseries data. I have a collection of highly dimensional 4D fMRI timeseries data collected while subjects were observing naturalistic images from COCO at regular intervals. We currently have decoding models that take preprocessed "snapshots" of this timeseries data flattened into an activation pattern that is aggregated over the short period the image was being observed, and use some machine learning models to decode and reconstruct the image content from the brain. (See some of my recent work). I am curious what sort of machine learning techniques exist that might be able to address the time-series data itself, without having to collapse the timeseries to a single snapshot to perform our decoding process. What I am envisioning is a model (perhaps a transformer) that can take as input a highly dimensional multichannel timeseries and output a flattened latent representation (say, a CLIP vector) corresponding to an image stimulus, or even a series of latent vectors separated by a known regular interval (as we have in our data for the different image presentations). To my knowledge most of the work in machine learning with time series data is in forecasting, but what I want is a static (or potentially repetitive) output. My hope is that the more detailed timeseries data will have additional signal that will boost decoding performance for fMRI vision decoding. Is there any existing work in the field of ML that has tackled a similar problem? submitted by /u/reesespike [link] [comments]

I have built a model for detecting outliers in a data series using ML.NET. I read from the dev forums that ML.NET using DirectML can support the new NPUs built into the new Core Ultra processors from Intel. I have not been able to find evidence that this is true for AutoML from the Microsoft team. Does anyone have experience using AutoML with DirectML backend? submitted by /u/tradingnumbers [link] [comments]

I looked up in so many places but couldn't find an answer. What happens if we switch Q and K to be from the encoder and decoder respectively? Would it make any difference? submitted by /u/shuvamg007 [link] [comments]

Hello everyone! I'm excited to discuss about Large Vision Language Model (LVLM). Since we're probably the biggest community into LLMs, I thought this channel would be the perfect place to start this conversation. Also, there isn't much out there on combining vision and language embeddings. A little background on LVLMs: They typically consist of a vision encoder for images, a regular tokenizer for text, a projection layer like an MLP to align vision features with text embedding spaces, and finally, merging both image and text embeddings for sending into the LLM model. The input includes both text and images, while the output is text, making it a multimodal LLM. Check out this diagram from the LLaVA paper for a visual breakdown: https://preview.redd.it/l222askgu1vc1.png?width=1607&format=png&auto=webp&s=ef011e16301c22b4751d8d0a8f3698f70e3ffd26 Starting with a vision encoder like CLIP ViT, the model learns visual information from images, then uses an MLP to project this onto the LLM's embedding space. The paper calls this feature alignment. I'm curious about how vision embeddings interact with text embeddings, so I experimented by visualizing them in 3D with PCA. For instance, take the llava-7B model—it uses the llama-7B backend with a 32k vocabulary size and 4096 dimensions, making the embedding size: [32000,4096]. I used a simple prompt, "Explain this image to me," with a picture of a cat to see how the embeddings appear in our space. https://preview.redd.it/032oy0ynu1vc1.png?width=662&format=png&auto=webp&s=d037bbecc976392e159a1c1bde775ef1e148488d Adding visual tokens changes the dynamics. Each image transforms into 576 vision tokens of shape [576,4096]. Check out how the plot adjusts when these tokens are included: https://preview.redd.it/9c3cu7ksu1vc1.png?width=660&format=png&auto=webp&s=c0aab6782fc309eba09ec660759bfaf48582dc14 The entire text embedding seems smaller, represented by tiny blue dots containing the entire llama-7B vocabulary. To zoom in further, I highlighted only the visual tokens near the embedding (meaning higher cosine similarity). Here’s how they cluster together: https://preview.redd.it/vdeacylwu1vc1.png?width=566&format=png&auto=webp&s=42441b4fd515cee916b40243429b4aa6820b998c So what do I think? First, we aren't directly converting visual tokens into text. A recent Google paper tried and found it wasn't the best approach. It seems that visual reasoning hovers close to text embedding spaces, likely because images are denser in information, requiring more tokens to represent visual concepts. Secondly, this setup seems right for now. Visual tokens, in context with text tokens, add image-derived context to the LLM, enabling it to 'see' an image. Lastly, even though llava is performing well on some benchmarks in visual reasoning, it might not be the most efficient at image representation yet. Some recent studies talked about it's sparse attention phenomenon, especially with visual tokens in LVLMs. We are just lucky because the attention algorithm attends to only meaningful visual tokens and ignores the noises. What do you think? Thanks for reading. 🙂 submitted by /u/E-fazz [link] [comments]

Can anyone recommend any good resources on modern time series forecasting with machine learning? I found one book on time series forecasting on Amazon with great reviews called Time Series Forecasting in Python. Having said that, a lot of machine learning books and resources seem to gloss over time series. What are some good resources (either entire books, or chapters in books) that cover time series? submitted by /u/secret_fyre [link] [comments]

Hi I am aware that a lot of transformer encoder variations exist (BERT, DistilBERT, Deberta, Roberta ...). However I am not interested in the best ones (that should probably be Deberta V3) but rather the ones that can quickly have decent results even with very few example examples (like ~50,100 sentences each containing maybe 1, 2 or 3 entities). I have done a few experiments in english, and to my surprise it seems that the one that perform best with as few data as possible is the original english BERT model (google-bert/bert-base-uncased on HF), and not one of the more recent variations. I have also done other experiments in french, and the multilingual BERT also quickly get decent results faster than models specially trained on french data (e.g CamemBERT). The models I've compared include : bert, bert multilingual, distilbert, distilbert multilingual, roberta, xlm-roberta, camembert, camemberta, distilroberta, debertav3, debertav3 multilingual What are your thought about this ? Is it something surprising or unusual ? Any advice ? submitted by /u/LelouchZer12 [link] [comments]

Noob question about word embeddings - As far as I understand so far - Contextualized word embeddings generated by BERT and other LLM type models use the attention mechanism and take into account the context of the word. So the same word in different sentences can have different vectors. This ^ is opposed to the older approach of models like word2vec - embeddings generated by word2vec are not contexual. However, looking closely at the CBOW and skip-gram models. it seems that they too try to predict the central word based on the surrounding (context) words. So the embeddings generated by word2vec can also be contextual. So they're both contexutal? What am I missing? submitted by /u/datashri [link] [comments]

By modern I mean any new innovation in the field of Speaker Verification. I was researching more about ML in the field of Audio - Speech in particular and I notice there are so many things going on right now with LLM being integrated into almost everything. So I was curious to know if there is any new innovation in the field of Speaker Recognition. Some of the cool libraries I came across were - pyannote.audio, speechbrain, Nvidia NeMo which provide the framework and pre-trained models for the task of Speaker Verification. Thanks in advance! ​ submitted by /u/Puzzleheaded_Bee5489 [link] [comments]

I have been doing some fine tuning work, and I am adjusting the weight decay and learning rate of my transformer models. My base model is BERT, and the fine tune data set is quite small. The issue I had was when I set incorrect hyperparameters, the model do not do anything. For example, if the optimal learning rate is 5e-3, but I am tuning it using 1e-2, 1e-3, 1e-4. Then the F measures are all 0.0. I understand the hyperparameter affects the results a lot. But I didn't expect it to be learn or not learn at all. I wonder if it is normal. cause 5e-3 and 1e-3 is not that much difference? submitted by /u/FFFFFQQQQ [link] [comments]

This is the first year (if I remember correclty) that MM shifts from CMT to Openreview. As an author I've been sensing something wrong since I created my submission, i.e. desk rejection even before abstract ddl, inconsistency about whether to include submission number within the paper, etc. Now I've heard a lot from social media that many authors without many/any publications (yes including me) have been nominated as reviewers due to their lack of reviewers for the submission volume. I'm very concerned about the quality of the reviews and the submission in MM2024 this year. submitted by /u/INeedPapers_TTT [link] [comments]

I am currently working on a fed batch process and I need to know if time series can be achieved with good accuracy. The idea is that there is a set of differential equations which create the data for me. After this data, a model is created with high accuracy. The question is, is it possible to achieve a time series prediction by giving the model a complete different set of initial conditions? My job is to have this model predict in completely different initial conditions so there is no need for real life testing on the batch process but just computational. I was looking into Neural ODE, UDE etc. in order for the model to understand the dynamics but I am also not sure if other methods of time series would work. (The data has no periodicity, correlated between each other etc.) What do you think would be the best approach since I am constantly trying different methods but none give accurate results? submitted by /u/Bitter__Physics [link] [comments]

I'm learning meths behind diffusion right now (DDPM, Score-based, and other approaches). I'm wondering how exactly did researchers come up with the idea? Does inventing new approaches go something like this? 1. We want to make better image generator. 2. Oh, the data will never be enough... 3. Let's multiply data - by adding some noise corruption 4. This this works well, what if we make a denoising network? 5. What if we make network that makes an image from pure noise? 6. That doesn't work, what if we did smaller denoising steps? 7. This works! Now, let's create some theory on why it works. 8. Write the paper Or something like this? 1. We want to make better image generator. 2. We know "nonequilibrium thermodynamics" really well and want to try applying it somehow 3. We somehow come up with an algorithm that relies on math from that theory 4. It works! 5. We write the paper. Which comes first usually? Math or Algorithm? submitted by /u/Deep-Station-1746 [link] [comments]