How Modern Mobile Apps Store Data: Extracting Financial Artifacts from a Realm Database Using Open-Source Forensic ToolsContinue reading on Medium »

Netflix today looks very different from the company that once mailed DVDs. Alongside streaming, it now runs mobile games, live events, and…Continue reading on Medium »

In the high-velocity world of foreign exchange, where fortunes are made on pip movements and market sentiment shifts in milliseconds…Continue reading on Medium »

Transactions promise safety.Continue reading on Stackademic »

Releem 2025 Recap: Building a Database Advisor for Developer TeamsContinue reading on Releem »

1. Redis Neden Ortaya Çıktı?Continue reading on Medium »

Artificial Intelligence is the engine of the future, but data is the fuel. If you pour dirty, stagnant fuel into a Ferrari, it won’t get…Continue reading on Medium »

mC4: The Multilingual Colossal Clean Crawled CorpusContinue reading on Medium »

I’m curious how people are using databases to persist application or system state that needs to survive restarts. In a lot of systems, especially stateful services or long-running processes, a local database ends up being the obvious solution for durability. SQLite, Postgres, or something embedded usually works, and in many cases it’s fast enough and simple enough to justify. What I’m trying to understand better is where people feel that approach starts to bend. For example, are you mostly treating the database as a simple state store, or does it end up carrying additional responsibilities like caching, fast repeated reads, or startup reconstruction? Do restart times, cold reads, or access patterns ever become noticeable, or does the database continue to feel like the right abstraction all the way through? I’ve seen setups where the database is technically correct but the system ends up layered with extra logic to compensate for warmup time, query overhead, or repeated access to the same state. Other times, teams just accept rebuild costs as part of the lifecycle and move on. I’m asking because we’ve been looking closely at this boundary between “a database is fine” and “this feels like the wrong abstraction”, particularly for local or performance-sensitive systems. We’re building something in this space and would be happy to share it with anyone interested, but the main goal here is understanding how database folks think about this trade-off in practice. Would love to hear where databases have worked well for you, and where you’ve felt friction, if at all. submitted by /u/DetectiveMindless652 [link] [comments]

When building a production-ready AI agent, model intelligence alone isn’t enough.Continue reading on Medium »

The One Time ‘It Works on My Machine’ was a DisasterContinue reading on Medium »

EDIT: sorry, the total number is actually 147. Here's a list. Which ones appear entirely unfamiliar to you? ABORT ACTION ADD AFTER ALL ALTER ANALYZE AND AS ASC ATTACH AUTOINCREMENT BEFORE BEGIN BETWEEN BY CASCADE CASE CAST CHECK COLLATE COLUMN COMMIT CONFLICT CONSTRAINT CREATE CROSS CURRENT_DATE CURRENT_TIME CURRENT_TIMESTAMP DATABASE DEFAULT DEFERRABLE DEFERRED DELETE DESC DETACH DISTINCT DO DROP EACH ELSE END ESCAPE EXCEPT EXCLUDE EXCLUSIVE EXISTS EXPLAIN FAIL FILTER FIRST FOLLOWING FOR FOREIGN FROM FULL GENERATED GLOB GROUP HAVING IF IGNORE IMMEDIATE IN INDEX INDEXED INITIALLY INNER INSERT INSTEAD INTERSECT INTO IS ISNULL JOIN KEY LEFT LIKE LIMIT MATCH MATERIALIZED NATURAL NO NOT NOTHING NOTNULL NULL NULLS OF OFFSET ON OR ORDER OTHERS OUTER OVER PARTITION PLAN PRAGMA PRIMARY QUERY RAISE RECURSIVE REFERENCES REGEXP REINDEX RELEASE RENAME REPLACE RESTRICT RETURNING RIGHT ROLLBACK ROW ROWS SAVEPOINT SELECT SET TABLE TEMP TEMPORARY THEN TO TRANSACTION TRIGGER UNION UNIQUE UPDATE USING VACUUM VALUES VIEW VIRTUAL WHEN WHERE WINDOW WITH WITHOUT FIRST FOLLOWING PRECEDING UNBOUNDED TIES DO FILTER EXCLUDE submitted by /u/No-Security-7518 [link] [comments]

submitted by /u/kristian54 [link] [comments]

I’m working on a POS system and I have a design question about sales history and product edits. Currently: Product table (name, price, editable) SaleDetail table with ProductId If a product’s name or price changes later, old sales would show the updated product data, which doesn’t seem correct for historical or accounting purposes. So the question is: Is it best practice to store a snapshot of product data at the time of sale? (e.g. product name, unit price, tax stored in SaleDetail, or in a separate snapshot table) More specifically: Should I embed snapshot fields directly in SaleDetail? Or create a separate ProductSnapshot (or version) table referenced by SaleDetail? Does this approach conflict with normalization, or is it considered standard for immutable records? Thanks! submitted by /u/Elegant-Drag-7141 [link] [comments]

submitted by /u/linuxhiker [link] [comments]

submitted by /u/be_haki [link] [comments]

I’ve been thinking a lot about video as a data source lately. With text, logs, and tables, everything is easy to index and query. With video… it’s still basically just files in folders plus some metadata. I’m exploring the idea of treating video more like structured data — for example, being able to answer questions like: “Show me every moment a person appears” “Find all clips where a car and a person appear together” “Jump to the exact second where this word was spoken” “Filter all videos recorded on a certain date that contain a vehicle” So instead of scrubbing timelines, you’d query a timeline. I’m curious how people here handle large video datasets today: - Do you just rely on filenames + timestamps + tags? - Are you extracting anything from the video itself (objects, text, audio)? - Has anyone tried indexing video content into a database for querying? submitted by /u/YiannisPits91 [link] [comments]

So I'm using MySQL workbench and spent almost the whole day trying to find out why this is not working. submitted by /u/Redd1tRat [link] [comments]

I did a bit of research about database encryption and it seems like MSSQL has the most capabilities in that area (Column level keys, deterministic encryption for queryable encryption, always encrypted capabilities (Intel SGX Enclave stuff) It seems that there are no real competitors in the open source area - the closest I found is pgcrypto for Postgres but it seems to be limited to encryption at rest? I wonder why that is the case - is it that complicated to implement something like that? Is there no actual need for this in real world scenarios? (aka is the M$ stuff just snakeoil?) [link] [comments]

Hi r/Database, i wanted to share a tool i built because i kept facing a common problem: receiving an urgent alert while out of the office - on vacation or at dinner -without a laptop nearby. i needed a way to quickly check the database, run a diagnostic query, or fix a record using just my phone. i built PgSQL Visual Manager for my own use, but realized other developers might need it too. Security First (How it works) i know using a mobile client for DB access requires trust, so here is the architecture: 100% Local: there is no backend service. We cannot see your data. Direct Connection: The app connects directly from your device to your PostgreSQL server (supports SSL and SSH Tunnel). Encrypted Storage: All passwords are stored using the device's native secure storage (Keychain on iOS, Encrypted Shared Preferences on Android). Core Functionality is isn't a bloated enterprise suite; it's a designed for emergency fixes and quick checks: Emergency Access Visual CRUD Custom SQL Table Inspector Data Export it is built by developers, for developers. i'd love to hear your feedbacks. submitted by /u/tobelyan [link] [comments]

I'm a high school student with no architecture experience volunteering to build an internal management system for a non-profit. They need a tool for staff to handle inventory, scheduling, and client check-ins. Because the data is sensitive, they strictly require the entire system to be self-hosted on a local server with absolutely zero cloud dependency. I also need the architecture to be flexible enough to eventually hook up a local AI model in the future, but that's a later problem. Given that I need to run this on a local machine and keep it secure, what specific stack (Frontend/Backend/Database) would you recommend for a beginner that is robust, easy to self-host, and easy to maintain? submitted by /u/No-Wrongdoer1409 [link] [comments]

Hi everyone, I have a use case and need advice on the right database: ~1,000 users, each with their own warehouses. Some warehouses have up to 1 million products. Data comes from suppliers every 2–4 hours, and I need to update the database quickly. Each product has fields like warehouse ID, type (e.g., car parts, screws), price, quantity, last update, tags, labels, etc. Users need to filter dynamically across most fields (~80%), including tags and labels. Requirements: Very fast insert/update, both in bulk (1000+ records) and single records. Fast filtering across many fields. No need for transactions – data can be overwritten. Question: Which database would work best for this? How would you efficiently handle millions of records every few hours while keeping fast filtering? OpenSearch ? MongoDB ? Thanks! submitted by /u/Notoa34 [link] [comments]

I've been building UnisonDB, a log native database in Go, for the past several months. The Goal is to support ISR-based replication to thousands of node effectivetly for local states and reads. Just added the support for Raft‑quorum writes on the server tier in the unisondb. Writes are committed by a Raft quorum on the write servers (if enabled); read‑only edge replicas/relayers stay ISR‑synced. https://preview.redd.it/hyy2nrgulrdg1.png?width=1398&format=png&auto=webp&s=654c0d615a88a6e0e4e58f2a53e6f17fb3c8fce5 Github: https://github.com/ankur-anand/unisondb submitted by /u/ankur-anand [link] [comments]

My background: I'm a sql server DBA and most of the data I work with is stored in some type of RDBMS. With that said, one of the tasks I'll be working on is storing resumes into a database, parsing them, and populating a page. I don't think SQL Server is the correct tool for this, plus it gives me the opportunity of learning other types of storage. The job is very similar to glassdoor's resume upload, in the sense that once a user uploads resume, the document is parsed, and then the fields in a webpage are populated with the information in the resume. What data store do you recommend for this type of storage? submitted by /u/East_Sentence_4245 [link] [comments]

When performing CRUD operations from the server to a database, how do I know what I need to worry about in terms of data integrity? So suppose I have multiple servers that rely on the same postgres DB. Am I supposed to be writing server code that will protect the DB? If two servers access the DB at the same time, one is updating a record that the other is reading, is this something I can expect postgres to automatically know how to deal with safely, or do I need to write code that locks DB access for modifications to only one request? While multiple reads can happen in parallel, that should be fine. I don't expect an answer that covers everything, maybe an idea of where to find the answer to this stuff. What does server code need to account for when running in parallel and accessing the same DB? submitted by /u/blind-octopus [link] [comments]

submitted by /u/diagraphic [link] [comments]

Hey, so my MariaDB suddenly stopped working, I thought not a big deal, export the current content using MySQL dump, but tbh, MariaDB isn't impressed with that, staying loading until I cancel. Any idea how to fix corrupted tables or extract my data? Also a better option then XAMP is also welcome 🫩 submitted by /u/Duckmastermind1 [link] [comments]

Hello Everyone, I am a Software Engineer with experience around 1.6 years and I have been working in the small startup where coding is the most of the task I do. I have a very good background in backend development and strong DSA knowledge but now I feel I am stuck and I am at a very comfortable position but that is absolutely killing my growth and career opportunity and for past 2 months, have been giving interviews and they are brutal at system design. We never really scaled any application rather we downscaled due to churn rate as well as. I have a very good backend development knowledge but now I need to step and move far ahead and I want to push my limits than anything. I have been looking for some system design videos on internet, mostly they are a list of videos just creating system design for any application like amazon, tik tok, instagram and what not, but I want to understand everything from very basic, I don't know when to scale the number of microservices, what AWS instance to opt for, wheather to put on EC2 or EKS, when to go for mongo and when for cassandra, what is read replica and what is quoroum and how to set that, when to use kafka, what is kafka. Please can you share your best resources which can help me understand system design from core and absolutely bulldoze the interviews. All kinds of resources, paid and unpaid, both I can go for but for best. Thanks. submitted by /u/Foreign_Pomelo9572 [link] [comments]

I am learning SQL and working on a personal project. Before I go ahead and build this database, I just wanted to get some feedback on my ER diagram. Specifically, I am not sure whether the types of relations I made are accurate. But, I am definitely open to any other feedback you might have. My goal is to create a basic airlines operations database that has the ability to track passenger, airport, and airline info to build itineraries. submitted by /u/sandmann07 [link] [comments]

Looked at neon they do give pg 18 but it isn't built with io_uring, can't truly get the benifits of async io select version(); version ----------------------------------------------------------------------------------------------------------------------- PostgreSQL 18.1 (32149dd) on aarch64-unknown-linux-gnu, compiled by gcc (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0, 64-bit (1 row) neondb=> select name, enumvals from pg_settings where name = 'io_method'; name | enumvals -----------+--------------- io_method | {sync,worker} Any provider that does that for free? submitted by /u/ThreadStarver [link] [comments]

I'm creating an app that may require thousands to tens of thousands of select queries to be sent to a PostgreSQL database. Is there an efficient way to handle that many requests? submitted by /u/paulchauwn [link] [comments]

I've been preparing for database-related interviews (backend/data/infra role), but I keep running into the same problem: my practical database skills don't always translate well to whiteboard discussions. In my daily work, I rely heavily on context: existing architecture, real data distribution, query plans, metrics, production environment constraints, etc. I iterate and validate hypotheses repeatedly. But whiteboarding lacks all of this. In interviews, I'm asked to design architectures, explain the role of indexes, and clearly articulate trade-offs. All of this has to be done from memory in a few minutes, with someone watching. I'm not very good at "thinking out loud," my thought process seems to take longer than average, and I speak relatively slowly... I get even more nervous and sometimes stutter when an interviewer is watching me. I've tried many methods to improve this "whiteboard thinking" ability. For example, redesigning previous architectures from scratch without looking at notes; practicing explaining design choices verbally; and using IQB interview questions to simulate the types of questions interviewers actually ask. Sometimes I use Beyz coding assistant and practice mock interviews with friends over Zoom to test the coherence of my reasoning when expressed verbally. I also try to avoid using any tools, forcing myself to think independently, but I don't know which of these methods are truly helpful for long-term improvement. How can I quickly improve my whiteboard thinking skills in a short amount of time? Any advice would be greatly appreciated! TIA! submitted by /u/Various_Candidate325 [link] [comments]

Hi Everyone, We’re planning a new infrastructure rehaul in our organization. The idea is: A Production database in a Production VNet A separate Testing VNet with a Test DB server When new code is pushed to the test environment, a test database is created from production data I’m leaning toward using Azure’s managed database restore from backup to create the test database. However, our sysadmin suggests manually dumping the production database (pg_dump) and restoring it into the test DB using scripts as part of the deployment. For those who’ve done this in Azure: Which approach is considered best practice? Is managed restore suitable for code-driven test deployments, or is pg_dump more common? Any real-world pros/cons? Would appreciate hearing how others handle this. Thanks! submitted by /u/Additional-Skirt-937 [link] [comments]

I’m having a bit of a problem with my website. I sent it off of digital products and the problem is that I have roughly around over 1 million files to upload to the site. The problem is not with the amount of storage but with the sheer number of files from my hosting plan I’m only allowed 700,000 files and unfortunately that will not be enough. I’m using C panel. and they were unsure what to do. I need the solution for this. They need at least 100 GB. Any suggestions anyone? For context these are zip files and video files. submitted by /u/Comfortable_Fly_6372 [link] [comments]

Our company's ERP system started with a few basic (but important) customizations, but over time each department has added new features based on what they need. And that makes sense because at first, we 100% needed to improve workflows, but now I'm seeing more and more bugs and slowdowns. The problem is, the more we customize, the harder it becomes to maintain. And whenever we need a really important big upgrade, it's kind of like building on top of crap.. So how can you tell when there's been too much customization? How do you not let it turn into technical debt? I need to understand this "add more features" VS clean up what you have thing, and whether or not we need to bring someone in to help, since we're thinking we can get Leverage Tech for ERP but we don't want to pay for a full new system (yet). submitted by /u/rennan [link] [comments]