Check out this example project on how to find transcripts of audio recordings with positive emotions. A good example of a project demonstrating of extract actionable insights from audio! It takes common voice dataset of audio files from hagging face, applies emotion recognition model and whisper-tiny model for the transcripts. All is organized in a nice looking batch pipeline. An interesting detail - No need to extract archives! This pipeline analyzes audio files directly from tar archives, saving you extra steps. Video: https://www.youtube.com/watch?v=OCm5W0L5BTU Colab notebook: https://colab.research.google.com/github/iterative/datachain-examples/blob/main/audio/hf_common_voice.ipynb Jupyter Notebook: https://github.com/iterative/datachain-examples/blob/main/audio/hf_common_voice.ipynb submitted by /u/dmpetrov [link] [comments]

There was a paper released along with a GitHub repository of an extremely well-made transformer designed for testing out new components. But I can't find it! It's not one of the ones that has existed like HuggingFace ones. Any clue? submitted by /u/Breck_Emert [link] [comments]

Hello folks, I've been working on an agentic solution where you can have an autonomous agent taking live calls. We're using a pipeline of Speech to Text, LLM for generating responses and then Text to Speech. In this pipeline, Speech to text is causing some issues because it's difficult to determine when exactly a sentence is over since the user can take pauses. Moreover, when multiple inputs go into LLM, multiple responses are generated and they queue up for Text to speech. How would you solve this problem? How would you also handle cases where the user interrupts the agent? submitted by /u/Leo2000Immortal [link] [comments]

We all saw in class the trade off between bias and variance, that we don't want our train loss to keep going down and our test loss go up. But in practice I feel like doing hyperparameter tuning for classic ML models with GridSearchCV / BayesSearchCV is not enough. Even though I do cross validation, the search.best_model obtained at the end is almost always overfitting. How can you actually perform a search that will give you a robust generalized model with higher chances ? submitted by /u/desslyie [link] [comments]

submitted by /u/BotherBubbly5096 [link] [comments]

Head to head of meme-interpretability with the same image and text prompt! Anecdotal but interesting responses. Also clear winner! submitted by /u/No_Cartoonist8629 [link] [comments]

In my academic field (social sciences) I deal with the problem of bias in SA models. My previous work showed that deep learning SA systems inherit bias (e.g. nonrepresentative of the population political bias) from annotators: https://arxiv.org/abs/2407.13891 Now I devised a solution that used a technique I call semantic blinding to provide only the bare necessary information for the model to predict emotions in text, leaving no signal for the model to overfit and produce bias from: https://arxiv.org/abs/2411.12493 Interested to hear your thoughts before I publish the SProp Gnn. Do you think it could be useful beyond the academia? submitted by /u/Hub_Pli [link] [comments]

When would the phase 2 decision come out? I know the date is December 9th, but would there be chances for the result to come out earlier than the announced date? or did it open the result at exact time in previous years? (i.e., 2024, 2023, 2022 ....) Kinda make me sick to keep waiting. submitted by /u/No-Style-7975 [link] [comments]

submitted by /u/mehul_gupta1997 [link] [comments]

Few months ago, I migrated from TF 2.0 to Jax. I found that jax is significantly faster than Tf. I noticed in the official documentation that it relies on XLA default that uses JIT compilation which makes execution faster. I also noticed that TF graphs also have option to enable JIT compilation with XLA. But still jax dominates TF with XLA. I just want to know why. submitted by /u/Odd-Detective289 [link] [comments]

Multimodal AI is changing the game by combining text, images, and even video into a single, cohesive system. It’s being talked about as a major leap in AI capabilities. What industries do you think will benefit the most from this tech? And are there any challenges you see in integrating these models into everyday use? Would love to hear everyone's thoughts! submitted by /u/Frosty_Programmer672 [link] [comments]

Say you’ve selected the best classifier for a particular problem, using threshold invariant metrics such as AUROC, Brier score, or log loss. It’s now time to choose the classification threshold. This will clearly depend on the use case and the cost/ benefits associated with true positives, false positives, etc. Often I see people advising to choose a threshold by looking at metrics such precision and recall. What I don’t see very often is people explicitly defining relative (or absolute, if possible) costs/ benefits of each cell in the confusion matrix (or more precisely the action that will be taken as a result). For example a true positive is worth $1000, a false positive -$500 and the other cells $0. You then optimise the threshold based on maximum benefit using a cost-threshold curve. The precision and recall can also be reported, but they are secondary to the benefit optimisation and not used directly in the choice. I find this much more intuitive and is my go-to. Does anyone else regularly use this approach? In what situations might this approach not make sense? submitted by /u/hazzaphill [link] [comments]

Hello everyone, I am looking for methods that can automatically categorize and select layers from for transfer learning. If you know any such methods or research please let me know or share. Thanks submitted by /u/reshail_raza [link] [comments]

Imagine a customer support chatbot for an e-commerce platform that retrieves relevant product details from its knowledge base and performs web searches for additional information. Furthermore, it remembers past conversations to deliver a seamless and personalized experience for returning users. Here is how it works: - Store your own data in the knowledge base—in our case, a Website URL. - Convert the data into embeddings and save it in the Qdrant Vector Database. - Use phidata Agentic Workflow to combine Tools, LLM, Memory, and the Knowledge Base. Code Implementation Video: https://www.youtube.com/watch?v=CDC3GOuJyZ0 submitted by /u/External_Ad_11 [link] [comments]

submitted by /u/mehul_gupta1997 [link] [comments]

New paper and code for the scale-wise transformer for fast text-to-image generation from our team at Yandex Research Switti outperforms existing T2I AR models and competes with state-of-the-art T2I diffusion models while being faster than distilled diffusion models. Code with checkpoints: https://github.com/yandex-research/switti Generation examples submitted by /u/_puhsu [link] [comments]

Hello everyone, I've been working on a project for some time now and wanted to share a concept I'm exploring. As we know, decision tree-based models typically split the feature space using certain metrics like MSE, entropy, etc. I started thinking about an alternative approach: instead of splitting individual features, what if we could split the entire space directly? However, this seemed quite difficult, as determining boundaries and regions in the space is challenging. Then I had an idea—what if I project the data onto a line within the feature space, and then split that line, like how trees are typically built on individual features? In essence, I’m thinking of projecting points onto a line and then using tree-based methods to split them progressively. Here's a high-level view of the algorithm: Fit a linear regression model to the dataset (normalized values). Project the data onto the line defined by the regression. Apply a decision tree on this projection, effectively splitting one feature (the projection axis). Calculate the residuals and fit another linear model on the residuals, applying boosting in the process. Since the new linear regressions fitted on the residuals will define separate lines, I assume that through boosting, the model will gradually divide the data in the desired manner over time. You can read a more detailed description of the algorithm here: Algorithm PDF. To visualize how the decision boundaries are formed in a 2D dataset: SpaceBoostingRegressor Note: If you want to see a visual example, uploading high-dimensional GIFs can sometimes be an issue. You can check out the example here: Gif on GitHub. Also you can check the code in the repository: Repository This approach is simple because it assumes linearity, and it works in scenarios where there is a high linear correlation between the target and features while also allowing for some non-linear relationships. You can see an example in the repo,example.ipynb file. However, I’m not sure how well it would perform on real-world datasets, as the linear assumption may not always hold. I want to take this algorithm further, but speed is important for scaling. Techniques like PCA don't seem to help because I need the line to reflect the variance in both the target and feature space, rather than just feature variance. I tried using MLPs and extracting the embeddings from a hidden layer before the output layer, which works better since we're evaluating the target in a larger space, but this approach becomes too slow and isn’t feasible in practice. I think this project has great potential, and I’m looking for feedback, ideas, or anyone interested in collaborating. Any comments or suggestions are welcome! submitted by /u/zedeleyici3401 [link] [comments]

Hoping to see if I can find any recommendations or suggestions into deploying R alongside other code (probably JavaScript) for commercial software. Hard to give away specifics as it is an extremely niche industry and I will dox myself immediately, but we need to use a Bayesian package that has primary been developed in R. Issue is, from my perspective, the package is poorly developed. No unit tests. poor/non-existent documentation, plus practically impossible to understand unless you have a PhD in Statistics along with a deep understanding of the niche industry I am in. Also, the values provided have to be "correct"... lawyers await us if not... While I am okay with statistics / maths, I am not at the level of the people that created this package, nor do I know anyone that would be in my immediate circle. The tested JAGS and untested STAN models are freely provided along with their papers. It is either I refactor the R package myself to allow for easier documentation / unit testing / maintainability, or I recreate it in Python (I am more confident with Python), or just utilise the package as is and pray to Thomas Bays for (probable) luck. Any feedback would be appreciated. submitted by /u/Sebyon [link] [comments]

Edit: I have misworded the title as if OpenAI would confirm how O1 was implemented. I have changed the text to reflect what I meant say. I really want to deep dive into the technicals of how the O1 models perform better than previous models. Have researchers come to any definitive agreement as to what OpenAI could have possible done to achieve O1? From reading online I hear about MCTS, COT... etc, but are any of these methods in large agreement by researhers? submitted by /u/Daveboi7 [link] [comments]

Hey everyone, I'm working on a pipeline to encode over 100 million rows into embeddings using SentenceTransformers, PySpark, and Pandas UDF on Dataproc Serverless. Currently, it takes several hours to process everything. I only have one column containing sentences, each under 30 characters long. These are encoded into 64-dimensional vectors using a custom model in a Docker image. At the moment, the job has been running for over 12 hours with 57 executors (each with 24GB of memory and 4 cores). I’ve partitioned the data into 2000 partitions, hoping to speed up the process, but it's still slow. Here’s the core part of my code: F.pandas_udf(returnType=ArrayType(FloatType())) def encode_pd(x: pd.Series) -> pd.Series: try: model = load_model() return pd.Series(model.encode(x, batch_size=512).tolist()) except Exception as e: logger.error(f"Error in encode_pd function: {str(e)}") raise The load_model function is as follows: def load_model() -> SentenceTransformer: model = SentenceTransformer( "custom_model", device="cpu", cache_folder=os.environ['SENTENCE_TRANSFORMERS_HOME'], truncate_dim=64 ) return model I tried broadcasting the model, but I couldn't refer to it inside the Pandas UDF. Does anyone have suggestions to optimize this? Perhaps ways to load the model more efficiently, reduce execution time, or better utilize resources? submitted by /u/nidalap24 [link] [comments]